2023-12-06T15:11:29.815 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-06T15:11:29.815 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-06_15:04:09-rbd-wip-yuri6-testing-2023-12-05-0753-pacific-distro-default-smithi/7480284 --name yuriw-2023-12-06_15:04:09-rbd-wip-yuri6-testing-2023-12-05-0753-pacific-distro-default-smithi --description rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_generic} --verbose -- /home/teuthworker/archive/yuriw-2023-12-06_15:04:09-rbd-wip-yuri6-testing-2023-12-05-0753-pacific-distro-default-smithi/7480284/orig.config.yaml 2023-12-06T15:11:29.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-06T15:11:29.922 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-12-06_15:04:09-rbd-wip-yuri6-testing-2023-12-05-0753-pacific-distro-default-smithi/7480284 branch: wip-yuri6-testing-2023-12-05-0753-pacific description: rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_generic} email: null first_in_suite: false job_id: '7480284' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2023-12-06_15:04:09-rbd-wip-yuri6-testing-2023-12-05-0753-pacific-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 30 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-yuri6-testing-2023-12-05-0753-pacific ceph: conf: client: rbd default format: 1 global: mon client directed command retry: 5 ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(CACHE_POOL_NEAR_FULL\) - \(CACHE_POOL_NO_HIT_SET\) sha1: d03fca4f35d43f61b4679936aef7bd2f01cced0b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d03fca4f35d43f61b4679936aef7bd2f01cced0b selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri6-testing-2023-12-05-0753-pacific sha1: d03fca4f35d43f61b4679936aef7bd2f01cced0b owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 5062 sha1: d03fca4f35d43f61b4679936aef7bd2f01cced0b sleep_before_teardown: 0 subset: 111/120000 suite: rbd suite_branch: wip-yuri6-testing-2023-12-05-0753-pacific suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_d03fca4f35d43f61b4679936aef7bd2f01cced0b/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: d03fca4f35d43f61b4679936aef7bd2f01cced0b targets: smithi123.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHeQVPISHcmI5TLqh0nLOypLb2joRoA+bSMQnZFLfT13MuvqO9kaVTuEeunWyXow20WNJyApaaPv4vHQNfEtb9M= tasks: - install: null - ceph: null - exec: client.0: - sudo ceph osd pool create cache 4 - sudo ceph osd tier add rbd cache - sudo ceph osd tier cache-mode cache writeback - sudo ceph osd tier set-overlay rbd cache - sudo ceph osd pool set cache hit_set_type bloom - sudo ceph osd pool set cache hit_set_count 8 - sudo ceph osd pool set cache hit_set_period 60 - sudo ceph osd pool set cache target_max_objects 250 - workunit: clients: client.0: - rbd/cli_generic.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: f2de108beb0a6dde7f3e6c96039071828a1f6269 timestamp: 2023-12-06_15:04:09 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-12-06T15:11:29.922 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_d03fca4f35d43f61b4679936aef7bd2f01cced0b/qa; will attempt to use it 2023-12-06T15:11:29.923 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_d03fca4f35d43f61b4679936aef7bd2f01cced0b/qa/tasks 2023-12-06T15:11:29.923 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-06T15:11:29.924 INFO:teuthology.task.internal:Checking packages... 2023-12-06T15:11:29.947 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd03fca4f35d43f61b4679936aef7bd2f01cced0b' 2023-12-06T15:11:29.947 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-06T15:11:29.947 INFO:teuthology.packaging:ref: None 2023-12-06T15:11:29.947 INFO:teuthology.packaging:tag: None 2023-12-06T15:11:29.947 INFO:teuthology.packaging:branch: wip-yuri6-testing-2023-12-05-0753-pacific 2023-12-06T15:11:29.947 INFO:teuthology.packaging:sha1: d03fca4f35d43f61b4679936aef7bd2f01cced0b 2023-12-06T15:11:29.948 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri6-testing-2023-12-05-0753-pacific 2023-12-06T15:11:30.186 INFO:teuthology.task.internal:Found packages for ceph version 16.2.14-335.gd03fca4f 2023-12-06T15:11:30.186 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-06T15:11:30.192 INFO:teuthology.task.internal:no buildpackages task found 2023-12-06T15:11:30.192 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-06T15:11:30.207 INFO:teuthology.task.internal:Saving configuration 2023-12-06T15:11:30.220 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-06T15:11:30.226 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-06T15:11:30.252 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-06_15:04:09-rbd-wip-yuri6-testing-2023-12-05-0753-pacific-distro-default-smithi/7480284', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-06 15:06:31.275173', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHeQVPISHcmI5TLqh0nLOypLb2joRoA+bSMQnZFLfT13MuvqO9kaVTuEeunWyXow20WNJyApaaPv4vHQNfEtb9M='} 2023-12-06T15:11:30.252 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-06T15:11:30.259 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2023-12-06T15:11:30.259 INFO:teuthology.run_tasks:Running task console_log... 2023-12-06T15:11:30.297 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0cf7accee0>, signals=[15]) 2023-12-06T15:11:30.298 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-06T15:11:30.303 INFO:teuthology.task.internal:Opening connections... 2023-12-06T15:11:30.303 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi123.front.sepia.ceph.com 2023-12-06T15:11:30.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T15:11:30.374 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-06T15:11:30.379 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2023-12-06T15:11:30.442 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2023-12-06T15:11:30.442 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-12-06T15:11:30.502 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream" 2023-12-06T15:11:30.503 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8" 2023-12-06T15:11:30.503 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos" 2023-12-06T15:11:30.503 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora" 2023-12-06T15:11:30.503 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8" 2023-12-06T15:11:30.503 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8" 2023-12-06T15:11:30.503 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-06T15:11:30.503 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2023-12-06T15:11:30.503 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-06T15:11:30.503 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/" 2023-12-06T15:11:30.503 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-06T15:11:30.504 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-06T15:11:30.504 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-06T15:11:30.505 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-12-06T15:11:30.525 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-06T15:11:30.533 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-06T15:11:30.539 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-06T15:11:30.539 DEBUG:teuthology.orchestra.run.smithi123:> test '!' -e /home/ubuntu/cephtest 2023-12-06T15:11:30.561 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-06T15:11:30.566 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-06T15:11:30.567 DEBUG:teuthology.orchestra.run.smithi123:> test -z $(ls -A /var/lib/ceph) 2023-12-06T15:11:30.641 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-06T15:11:30.672 INFO:teuthology.run_tasks:Running task kernel... 2023-12-06T15:11:30.688 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-12-06T15:11:30.688 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-12-06T15:11:30.688 DEBUG:teuthology.orchestra.run.smithi123:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-06T15:11:30.707 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-06T15:11:30.707 DEBUG:teuthology.orchestra.run.smithi123:> uname -r 2023-12-06T15:11:30.766 INFO:teuthology.orchestra.run.smithi123.stdout:4.18.0-489.el8.x86_64 2023-12-06T15:11:30.766 INFO:teuthology.task.kernel:Running kernel on smithi123: 4.18.0-489.el8.x86_64 2023-12-06T15:11:30.767 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum install -y kernel 2023-12-06T15:11:37.641 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 8 - AppStream 8.0 MB/s | 34 MB 00:04 2023-12-06T15:11:51.706 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 8 - BaseOS 7.0 MB/s | 55 MB 00:07 2023-12-06T15:11:59.922 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 8 - Extras 61 kB/s | 18 kB 00:00 2023-12-06T15:12:00.598 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 8 - Extras common packages 14 kB/s | 6.9 kB 00:00 2023-12-06T15:12:00.941 INFO:teuthology.orchestra.run.smithi123.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-12-06T15:12:03.777 INFO:teuthology.orchestra.run.smithi123.stdout:Extra Packages for Enterprise Linux 5.9 MB/s | 16 MB 00:02 2023-12-06T15:12:07.612 INFO:teuthology.orchestra.run.smithi123.stdout:lab-extras 291 kB/s | 24 kB 00:00 2023-12-06T15:12:11.291 INFO:teuthology.orchestra.run.smithi123.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-12-06T15:12:11.292 INFO:teuthology.orchestra.run.smithi123.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-12-06T15:12:11.581 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2023-12-06T15:12:11.581 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:12:11.582 INFO:teuthology.orchestra.run.smithi123.stdout: Package Architecture Version Repository Size 2023-12-06T15:12:11.582 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:12:11.582 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2023-12-06T15:12:11.582 INFO:teuthology.orchestra.run.smithi123.stdout: kernel x86_64 4.18.0-526.el8 baseos 10 M 2023-12-06T15:12:11.582 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2023-12-06T15:12:11.582 INFO:teuthology.orchestra.run.smithi123.stdout: kernel-core x86_64 4.18.0-526.el8 baseos 43 M 2023-12-06T15:12:11.582 INFO:teuthology.orchestra.run.smithi123.stdout: kernel-modules x86_64 4.18.0-526.el8 baseos 36 M 2023-12-06T15:12:11.582 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:12:11.582 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2023-12-06T15:12:11.582 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:12:11.582 INFO:teuthology.orchestra.run.smithi123.stdout:Install 3 Packages 2023-12-06T15:12:11.582 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:12:11.583 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 90 M 2023-12-06T15:12:11.583 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 96 M 2023-12-06T15:12:11.583 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2023-12-06T15:12:12.860 INFO:teuthology.orchestra.run.smithi123.stdout:(1/3): kernel-4.18.0-526.el8.x86_64.rpm 8.3 MB/s | 10 MB 00:01 2023-12-06T15:12:13.935 INFO:teuthology.orchestra.run.smithi123.stdout:(2/3): kernel-modules-4.18.0-526.el8.x86_64.rpm 16 MB/s | 36 MB 00:02 2023-12-06T15:12:14.711 INFO:teuthology.orchestra.run.smithi123.stdout:(3/3): kernel-core-4.18.0-526.el8.x86_64.rpm 14 MB/s | 43 MB 00:03 2023-12-06T15:12:14.711 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2023-12-06T15:12:14.711 INFO:teuthology.orchestra.run.smithi123.stdout:Total 29 MB/s | 90 MB 00:03 2023-12-06T15:12:15.386 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2023-12-06T15:12:15.799 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2023-12-06T15:12:15.799 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2023-12-06T15:12:17.031 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2023-12-06T15:12:17.064 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2023-12-06T15:12:19.849 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2023-12-06T15:12:20.417 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : kernel-core-4.18.0-526.el8.x86_64 1/3 2023-12-06T15:12:24.022 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: kernel-core-4.18.0-526.el8.x86_64 1/3 2023-12-06T15:12:24.449 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : kernel-modules-4.18.0-526.el8.x86_64 2/3 2023-12-06T15:12:27.874 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: kernel-modules-4.18.0-526.el8.x86_64 2/3 2023-12-06T15:12:28.163 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : kernel-4.18.0-526.el8.x86_64 3/3 2023-12-06T15:12:50.069 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: kernel-core-4.18.0-526.el8.x86_64 3/3 2023-12-06T15:12:50.093 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: kernel-modules-4.18.0-526.el8.x86_64 3/3 2023-12-06T15:12:50.440 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: kernel-4.18.0-526.el8.x86_64 3/3 2023-12-06T15:12:50.440 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : kernel-4.18.0-526.el8.x86_64 1/3 2023-12-06T15:12:50.440 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : kernel-core-4.18.0-526.el8.x86_64 2/3 2023-12-06T15:12:51.281 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : kernel-modules-4.18.0-526.el8.x86_64 3/3 2023-12-06T15:12:51.281 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:12:51.281 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2023-12-06T15:12:51.282 INFO:teuthology.orchestra.run.smithi123.stdout: kernel-4.18.0-526.el8.x86_64 kernel-core-4.18.0-526.el8.x86_64 2023-12-06T15:12:51.282 INFO:teuthology.orchestra.run.smithi123.stdout: kernel-modules-4.18.0-526.el8.x86_64 2023-12-06T15:12:51.282 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:12:51.282 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2023-12-06T15:12:51.417 DEBUG:teuthology.orchestra.run.smithi123:> rpm -q kernel | sort -rV | head -n 1 2023-12-06T15:12:51.633 INFO:teuthology.orchestra.run.smithi123.stdout:kernel-4.18.0-526.el8.x86_64 2023-12-06T15:12:51.633 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-526.el8.x86_64 2023-12-06T15:12:51.633 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-526.el8.x86_64 2023-12-06T15:12:51.633 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-06T15:12:51.633 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-06T15:12:51.633 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-12-06T15:12:51.633 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi123.front.sepia.ceph.com, path=None, version=distro) 2023-12-06T15:12:51.634 DEBUG:teuthology.orchestra.run.smithi123:> rpm -q kernel | sort -rV | head -n 1 2023-12-06T15:12:51.844 INFO:teuthology.orchestra.run.smithi123.stdout:kernel-4.18.0-526.el8.x86_64 2023-12-06T15:12:51.845 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-526.el8.x86_64 2023-12-06T15:12:51.845 DEBUG:teuthology.orchestra.run.smithi123:> sudo rpm -qi grub2-tools 2023-12-06T15:12:51.879 INFO:teuthology.orchestra.run.smithi123.stdout:Name : grub2-tools 2023-12-06T15:12:51.879 INFO:teuthology.orchestra.run.smithi123.stdout:Epoch : 1 2023-12-06T15:12:51.879 INFO:teuthology.orchestra.run.smithi123.stdout:Version : 2.02 2023-12-06T15:12:51.879 INFO:teuthology.orchestra.run.smithi123.stdout:Release : 129.el8 2023-12-06T15:12:51.879 INFO:teuthology.orchestra.run.smithi123.stdout:Architecture: x86_64 2023-12-06T15:12:51.879 INFO:teuthology.orchestra.run.smithi123.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-12-06T15:12:51.880 INFO:teuthology.orchestra.run.smithi123.stdout:Group : System Environment/Base 2023-12-06T15:12:51.880 INFO:teuthology.orchestra.run.smithi123.stdout:Size : 9265586 2023-12-06T15:12:51.880 INFO:teuthology.orchestra.run.smithi123.stdout:License : GPLv3+ 2023-12-06T15:12:51.880 INFO:teuthology.orchestra.run.smithi123.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-12-06T15:12:51.880 INFO:teuthology.orchestra.run.smithi123.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-12-06T15:12:51.880 INFO:teuthology.orchestra.run.smithi123.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-12-06T15:12:51.880 INFO:teuthology.orchestra.run.smithi123.stdout:Build Host : kbuilder.bsys.centos.org 2023-12-06T15:12:51.880 INFO:teuthology.orchestra.run.smithi123.stdout:Relocations : (not relocatable) 2023-12-06T15:12:51.880 INFO:teuthology.orchestra.run.smithi123.stdout:Packager : CentOS BuildSystem 2023-12-06T15:12:51.880 INFO:teuthology.orchestra.run.smithi123.stdout:Vendor : CentOS 2023-12-06T15:12:51.880 INFO:teuthology.orchestra.run.smithi123.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-06T15:12:51.880 INFO:teuthology.orchestra.run.smithi123.stdout:Summary : Support tools for GRUB. 2023-12-06T15:12:51.880 INFO:teuthology.orchestra.run.smithi123.stdout:Description : 2023-12-06T15:12:51.881 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:12:51.881 INFO:teuthology.orchestra.run.smithi123.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-06T15:12:51.881 INFO:teuthology.orchestra.run.smithi123.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-06T15:12:51.881 INFO:teuthology.orchestra.run.smithi123.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-06T15:12:51.881 INFO:teuthology.orchestra.run.smithi123.stdout:hardware devices. 2023-12-06T15:12:51.881 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:12:51.881 INFO:teuthology.orchestra.run.smithi123.stdout:This subpackage provides tools for support of all platforms. 2023-12-06T15:12:51.882 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-06T15:12:51.882 INFO:teuthology.task.kernel:Updating grub on smithi123 to boot 4.18.0-526.el8.x86_64 2023-12-06T15:12:51.882 DEBUG:teuthology.orchestra.run.smithi123:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-06T15:12:53.547 INFO:teuthology.orchestra.run.smithi123.stderr:Generating grub configuration file ... 2023-12-06T15:12:55.392 INFO:teuthology.orchestra.run.smithi123.stderr:done 2023-12-06T15:12:55.393 DEBUG:teuthology.orchestra.run.smithi123:> mktemp 2023-12-06T15:12:55.420 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/tmp.XtfxNvMytM 2023-12-06T15:12:55.421 DEBUG:teuthology.orchestra.run.smithi123:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.XtfxNvMytM 2023-12-06T15:12:55.505 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0666 /tmp/tmp.XtfxNvMytM 2023-12-06T15:12:55.608 DEBUG:teuthology.orchestra.remote:smithi123:/tmp/tmp.XtfxNvMytM is 6KB 2023-12-06T15:12:55.656 DEBUG:teuthology.orchestra.run.smithi123:> rm -fr /tmp/tmp.XtfxNvMytM 2023-12-06T15:12:55.673 DEBUG:teuthology.orchestra.run.smithi123:> sudo /bin/ls /boot/loader/entries || true 2023-12-06T15:12:55.748 INFO:teuthology.orchestra.run.smithi123.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-12-06T15:12:55.748 INFO:teuthology.orchestra.run.smithi123.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-12-06T15:12:55.748 INFO:teuthology.orchestra.run.smithi123.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-12-06T15:12:55.748 INFO:teuthology.orchestra.run.smithi123.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-526.el8.x86_64.conf 2023-12-06T15:12:55.749 DEBUG:teuthology.orchestra.run.smithi123:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-526.el8.x86_64 2023-12-06T15:12:55.886 DEBUG:teuthology.orchestra.run.smithi123:> sudo shutdown -r now 2023-12-06T15:13:25.919 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-12-06T15:13:25.920 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-12-06T15:13:25.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T15:14:00.418 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-12-06T15:14:09.426 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-12-06T15:14:09.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T15:14:27.810 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-12-06T15:14:39.822 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-12-06T15:14:39.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T15:14:40.170 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-12-06T15:14:40.404 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-12-06T15:14:40.404 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-526.el8.x86_64"... 2023-12-06T15:14:40.405 DEBUG:teuthology.orchestra.run.smithi123:> uname -r 2023-12-06T15:14:40.421 INFO:teuthology.orchestra.run.smithi123.stdout:4.18.0-526.el8.x86_64 2023-12-06T15:14:40.421 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-526.el8.x86_64 vs 4.18.0-526.el8.x86_64 2023-12-06T15:14:40.421 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-06T15:14:40.421 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-06T15:14:41.422 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-12-06T15:14:41.422 DEBUG:teuthology.orchestra.run.smithi123:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-06T15:14:41.508 INFO:teuthology.orchestra.run.smithi123.stdout:ttyS1 2023-12-06T15:14:41.519 DEBUG:teuthology.parallel:result is None 2023-12-06T15:14:41.519 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-06T15:14:41.526 INFO:teuthology.task.internal:Creating test directory... 2023-12-06T15:14:41.526 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-06T15:14:41.544 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-06T15:14:41.550 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-06T15:14:41.557 INFO:teuthology.task.internal:Creating archive directory... 2023-12-06T15:14:41.557 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-06T15:14:41.613 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-06T15:14:41.620 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-06T15:14:41.620 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-06T15:14:41.678 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-06T15:14:41.689 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-06T15:14:41.691 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-06T15:14:41.697 INFO:teuthology.task.internal:Configuring sudo... 2023-12-06T15:14:41.698 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-06T15:14:41.758 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-06T15:14:41.767 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-06T15:14:41.767 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-06T15:14:41.815 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-06T15:14:41.900 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-06T15:14:42.035 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-06T15:14:42.078 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-06T15:14:42.121 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-12-06T15:14:42.122 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-06T15:14:42.188 DEBUG:teuthology.orchestra.run.smithi123:> sudo service rsyslog restart 2023-12-06T15:14:42.360 INFO:teuthology.orchestra.run.smithi123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-06T15:14:42.926 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-06T15:14:42.935 INFO:teuthology.task.internal:Starting timer... 2023-12-06T15:14:42.935 INFO:teuthology.run_tasks:Running task pcp... 2023-12-06T15:14:42.945 INFO:teuthology.run_tasks:Running task selinux... 2023-12-06T15:14:42.955 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-12-06T15:14:42.955 DEBUG:teuthology.orchestra.run.smithi123:> sudo service auditd rotate 2023-12-06T15:14:43.227 INFO:teuthology.orchestra.run.smithi123.stdout:Rotating logs: 2023-12-06T15:14:43.248 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-06T15:14:43.248 DEBUG:teuthology.orchestra.run.smithi123:> /usr/sbin/getenforce 2023-12-06T15:14:43.306 INFO:teuthology.orchestra.run.smithi123.stdout:Permissive 2023-12-06T15:14:43.306 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi123.front.sepia.ceph.com': 'permissive'} 2023-12-06T15:14:43.306 DEBUG:teuthology.orchestra.run.smithi123:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-06T15:14:43.806 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-06T15:14:43.806 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-06T15:14:43.807 DEBUG:teuthology.orchestra.run.smithi123:> sudo /usr/sbin/setenforce permissive 2023-12-06T15:14:44.256 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-06T15:14:44.267 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-06T15:14:44.267 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-06T15:14:44.283 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-06T15:14:44.284 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi123.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-06T15:21:58.491 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi123.front.sepia.ceph.com')] 2023-12-06T15:21:58.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-12-06T15:21:58.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T15:21:58.562 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-12-06T15:21:58.633 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-12-06T15:21:58.633 INFO:teuthology.run_tasks:Running task clock... 2023-12-06T15:21:58.650 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-06T15:21:58.650 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-06T15:21:58.651 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-06T15:21:58.706 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-06T15:21:58.720 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-06T15:21:58.796 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: ntpd: command not found 2023-12-06T15:21:58.807 INFO:teuthology.orchestra.run.smithi123.stdout:506 Cannot talk to daemon 2023-12-06T15:21:58.822 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-06T15:21:58.834 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-06T15:21:58.898 INFO:teuthology.orchestra.run.smithi123.stderr:bash: ntpq: command not found 2023-12-06T15:21:58.901 INFO:teuthology.orchestra.run.smithi123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-06T15:21:58.902 INFO:teuthology.orchestra.run.smithi123.stdout:=============================================================================== 2023-12-06T15:21:58.902 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-06T15:21:58.902 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-06T15:21:58.902 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-06T15:21:58.902 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-06T15:21:58.903 INFO:teuthology.run_tasks:Running task install... 2023-12-06T15:21:58.911 DEBUG:teuthology.task.install:project ceph 2023-12-06T15:21:58.912 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd03fca4f35d43f61b4679936aef7bd2f01cced0b'}} 2023-12-06T15:21:58.912 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'd03fca4f35d43f61b4679936aef7bd2f01cced0b'} 2023-12-06T15:21:58.912 INFO:teuthology.task.install:Using flavor: default 2023-12-06T15:21:58.917 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-06T15:21:58.917 INFO:teuthology.task.install:extra packages: [] 2023-12-06T15:21:58.917 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd03fca4f35d43f61b4679936aef7bd2f01cced0b', 'tag': None, 'wait_for_package': False} 2023-12-06T15:21:58.918 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d03fca4f35d43f61b4679936aef7bd2f01cced0b 2023-12-06T15:21:59.065 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-12-05-0753-pacific/d03fca4f35d43f61b4679936aef7bd2f01cced0b/centos/8/flavors/default/ 2023-12-06T15:21:59.065 INFO:teuthology.task.install.rpm:Package version is 16.2.14-335.gd03fca4f 2023-12-06T15:21:59.247 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-12-05-0753-pacific/d03fca4f35d43f61b4679936aef7bd2f01cced0b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-12-05-0753-pacific/d03fca4f35d43f61b4679936aef7bd2f01cced0b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-12-05-0753-pacific/d03fca4f35d43f61b4679936aef7bd2f01cced0b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-06T15:21:59.247 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-12-06T15:21:59.247 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-06T15:21:59.276 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-06T15:21:59.277 DEBUG:teuthology.orchestra.run.smithi123:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d03fca4f35d43f61b4679936aef7bd2f01cced0b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-06T15:21:59.345 DEBUG:teuthology.orchestra.run.smithi123:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-06T15:21:59.422 DEBUG:teuthology.orchestra.run.smithi123:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-06T15:21:59.489 INFO:teuthology.orchestra.run.smithi123.stdout:check_obsoletes = 1 2023-12-06T15:21:59.490 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum clean all 2023-12-06T15:21:59.758 INFO:teuthology.orchestra.run.smithi123.stdout:76 files removed 2023-12-06T15:21:59.785 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-radosgw 2023-12-06T15:22:00.633 INFO:teuthology.orchestra.run.smithi123.stdout:ceph packages for x86_64 173 kB/s | 76 kB 00:00 2023-12-06T15:22:01.017 INFO:teuthology.orchestra.run.smithi123.stdout:ceph noarch packages 44 kB/s | 15 kB 00:00 2023-12-06T15:22:01.434 INFO:teuthology.orchestra.run.smithi123.stdout:ceph source packages 3.7 kB/s | 1.4 kB 00:00 2023-12-06T15:22:02.910 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 8 - AppStream 24 MB/s | 34 MB 00:01 2023-12-06T15:22:12.443 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 8 - BaseOS 18 MB/s | 55 MB 00:03 2023-12-06T15:22:20.569 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 8 - Extras 55 kB/s | 18 kB 00:00 2023-12-06T15:22:21.244 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 8 - Extras common packages 14 kB/s | 6.9 kB 00:00 2023-12-06T15:22:22.354 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 8 - PowerTools 6.9 MB/s | 6.6 MB 00:00 2023-12-06T15:22:23.805 INFO:teuthology.orchestra.run.smithi123.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-12-06T15:22:24.747 INFO:teuthology.orchestra.run.smithi123.stdout:Extra Packages for Enterprise Linux 20 MB/s | 16 MB 00:00 2023-12-06T15:22:28.606 INFO:teuthology.orchestra.run.smithi123.stdout:lab-extras 498 kB/s | 24 kB 00:00 2023-12-06T15:22:33.181 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2023-12-06T15:22:33.183 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:22:33.183 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2023-12-06T15:22:33.183 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:22:33.183 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2023-12-06T15:22:33.183 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 12 M 2023-12-06T15:22:33.184 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrading: 2023-12-06T15:22:33.184 INFO:teuthology.orchestra.run.smithi123.stdout: librados2 x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 3.7 M 2023-12-06T15:22:33.184 INFO:teuthology.orchestra.run.smithi123.stdout: librbd1 x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 4.2 M 2023-12-06T15:22:33.184 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2023-12-06T15:22:33.184 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 6.1 M 2023-12-06T15:22:33.184 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 24 M 2023-12-06T15:22:33.184 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-selinux x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 26 k 2023-12-06T15:22:33.184 INFO:teuthology.orchestra.run.smithi123.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-06T15:22:33.184 INFO:teuthology.orchestra.run.smithi123.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-12-06T15:22:33.184 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2 x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 824 k 2023-12-06T15:22:33.184 INFO:teuthology.orchestra.run.smithi123.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-06T15:22:33.184 INFO:teuthology.orchestra.run.smithi123.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-12-06T15:22:33.184 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1 x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 493 k 2023-12-06T15:22:33.184 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-12-06T15:22:33.185 INFO:teuthology.orchestra.run.smithi123.stdout: librgw2 x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 3.8 M 2023-12-06T15:22:33.185 INFO:teuthology.orchestra.run.smithi123.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-06T15:22:33.185 INFO:teuthology.orchestra.run.smithi123.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-12-06T15:22:33.185 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 45 k 2023-12-06T15:22:33.185 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 99 k 2023-12-06T15:22:33.185 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 215 k 2023-12-06T15:22:33.185 INFO:teuthology.orchestra.run.smithi123.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-12-06T15:22:33.185 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 389 k 2023-12-06T15:22:33.185 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 369 k 2023-12-06T15:22:33.185 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 114 k 2023-12-06T15:22:33.185 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:22:33.185 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2023-12-06T15:22:33.185 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:22:33.185 INFO:teuthology.orchestra.run.smithi123.stdout:Install 21 Packages 2023-12-06T15:22:33.185 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrade 2 Packages 2023-12-06T15:22:33.186 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:22:33.186 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 57 M 2023-12-06T15:22:33.186 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2023-12-06T15:22:34.649 INFO:teuthology.orchestra.run.smithi123.stdout:(1/23): ceph-base-16.2.14-335.gd03fca4f.el8.x86 4.5 MB/s | 6.1 MB 00:01 2023-12-06T15:22:34.741 INFO:teuthology.orchestra.run.smithi123.stdout:(2/23): ceph-selinux-16.2.14-335.gd03fca4f.el8. 280 kB/s | 26 kB 00:00 2023-12-06T15:22:34.908 INFO:teuthology.orchestra.run.smithi123.stdout:(3/23): ceph-radosgw-16.2.14-335.gd03fca4f.el8. 7.2 MB/s | 12 MB 00:01 2023-12-06T15:22:34.941 INFO:teuthology.orchestra.run.smithi123.stdout:(4/23): libcephfs2-16.2.14-335.gd03fca4f.el8.x8 4.0 MB/s | 824 kB 00:00 2023-12-06T15:22:34.975 INFO:teuthology.orchestra.run.smithi123.stdout:(5/23): libradosstriper1-16.2.14-335.gd03fca4f. 7.2 MB/s | 493 kB 00:00 2023-12-06T15:22:35.025 INFO:teuthology.orchestra.run.smithi123.stdout:(6/23): python3-ceph-argparse-16.2.14-335.gd03f 898 kB/s | 45 kB 00:00 2023-12-06T15:22:35.092 INFO:teuthology.orchestra.run.smithi123.stdout:(7/23): python3-ceph-common-16.2.14-335.gd03fca 1.4 MB/s | 99 kB 00:00 2023-12-06T15:22:35.159 INFO:teuthology.orchestra.run.smithi123.stdout:(8/23): python3-cephfs-16.2.14-335.gd03fca4f.el 3.2 MB/s | 215 kB 00:00 2023-12-06T15:22:35.234 INFO:teuthology.orchestra.run.smithi123.stdout:(9/23): python3-rados-16.2.14-335.gd03fca4f.el8 5.1 MB/s | 389 kB 00:00 2023-12-06T15:22:35.285 INFO:teuthology.orchestra.run.smithi123.stdout:(10/23): librgw2-16.2.14-335.gd03fca4f.el8.x86_ 11 MB/s | 3.8 MB 00:00 2023-12-06T15:22:35.310 INFO:teuthology.orchestra.run.smithi123.stdout:(11/23): python3-rbd-16.2.14-335.gd03fca4f.el8. 4.8 MB/s | 369 kB 00:00 2023-12-06T15:22:35.369 INFO:teuthology.orchestra.run.smithi123.stdout:(12/23): python3-rgw-16.2.14-335.gd03fca4f.el8. 1.3 MB/s | 114 kB 00:00 2023-12-06T15:22:35.644 INFO:teuthology.orchestra.run.smithi123.stdout:(13/23): librdkafka-0.11.4-3.el8.x86_64.rpm 1.0 MB/s | 354 kB 00:00 2023-12-06T15:22:35.694 INFO:teuthology.orchestra.run.smithi123.stdout:(14/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 798 kB/s | 259 kB 00:00 2023-12-06T15:22:35.720 INFO:teuthology.orchestra.run.smithi123.stdout:(15/23): python3-prettytable-0.7.2-14.el8.noarc 583 kB/s | 44 kB 00:00 2023-12-06T15:22:35.995 INFO:teuthology.orchestra.run.smithi123.stdout:(16/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2023-12-06T15:22:36.028 INFO:teuthology.orchestra.run.smithi123.stdout:(17/23): librabbitmq-0.9.0-4.el8.x86_64.rpm 141 kB/s | 47 kB 00:00 2023-12-06T15:22:36.062 INFO:teuthology.orchestra.run.smithi123.stdout:(18/23): leveldb-1.22-1.el8.x86_64.rpm 2.6 MB/s | 181 kB 00:00 2023-12-06T15:22:36.121 INFO:teuthology.orchestra.run.smithi123.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 1.3 MB/s | 75 kB 00:00 2023-12-06T15:22:36.179 INFO:teuthology.orchestra.run.smithi123.stdout:(20/23): liboath-2.6.2-3.el8.x86_64.rpm 390 kB/s | 59 kB 00:00 2023-12-06T15:22:36.405 INFO:teuthology.orchestra.run.smithi123.stdout:(21/23): ceph-common-16.2.14-335.gd03fca4f.el8. 7.8 MB/s | 24 MB 00:03 2023-12-06T15:22:36.622 INFO:teuthology.orchestra.run.smithi123.stdout:(22/23): librbd1-16.2.14-335.gd03fca4f.el8.x86_ 9.4 MB/s | 4.2 MB 00:00 2023-12-06T15:22:36.713 INFO:teuthology.orchestra.run.smithi123.stdout:(23/23): librados2-16.2.14-335.gd03fca4f.el8.x8 6.3 MB/s | 3.7 MB 00:00 2023-12-06T15:22:36.715 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2023-12-06T15:22:36.716 INFO:teuthology.orchestra.run.smithi123.stdout:Total 16 MB/s | 57 MB 00:03 2023-12-06T15:22:36.753 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2023-12-06T15:22:36.798 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2023-12-06T15:22:36.798 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2023-12-06T15:22:37.168 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2023-12-06T15:22:37.171 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2023-12-06T15:22:38.235 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2023-12-06T15:22:38.696 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2023-12-06T15:22:38.859 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-06T15:22:39.247 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-06T15:22:39.434 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : librados2-2:16.2.14-335.gd03fca4f.el8.x86_64 3/25 2023-12-06T15:22:39.534 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados2-2:16.2.14-335.gd03fca4f.el8.x86_64 3/25 2023-12-06T15:22:39.790 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rados-2:16.2.14-335.gd03fca4f.el8.x86_64 4/25 2023-12-06T15:22:39.992 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephfs2-2:16.2.14-335.gd03fca4f.el8.x86_64 5/25 2023-12-06T15:22:40.403 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephfs2-2:16.2.14-335.gd03fca4f.el8.x86_64 5/25 2023-12-06T15:22:40.592 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : librbd1-2:16.2.14-335.gd03fca4f.el8.x86_64 6/25 2023-12-06T15:22:40.660 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librbd1-2:16.2.14-335.gd03fca4f.el8.x86_64 6/25 2023-12-06T15:22:40.899 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 7/25 2023-12-06T15:22:41.050 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 8/25 2023-12-06T15:22:41.426 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 8/25 2023-12-06T15:22:41.576 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librgw2-2:16.2.14-335.gd03fca4f.el8.x86_64 9/25 2023-12-06T15:22:41.651 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librgw2-2:16.2.14-335.gd03fca4f.el8.x86_64 9/25 2023-12-06T15:22:41.856 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2023-12-06T15:22:42.064 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ceph-argparse-2:16.2.14-335.gd03fca4f.el8. 11/25 2023-12-06T15:22:42.254 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cephfs-2:16.2.14-335.gd03fca4f.el8.x86_64 12/25 2023-12-06T15:22:42.477 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rgw-2:16.2.14-335.gd03fca4f.el8.x86_64 13/25 2023-12-06T15:22:42.709 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rbd-2:16.2.14-335.gd03fca4f.el8.x86_64 14/25 2023-12-06T15:22:42.834 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libradosstriper1-2:16.2.14-335.gd03fca4f.el8.x86_6 15/25 2023-12-06T15:22:42.905 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libradosstriper1-2:16.2.14-335.gd03fca4f.el8.x86_6 15/25 2023-12-06T15:22:43.126 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2023-12-06T15:22:43.325 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2023-12-06T15:22:43.487 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-12-06T15:22:43.667 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ceph-common-2:16.2.14-335.gd03fca4f.el8.x8 19/25 2023-12-06T15:22:46.187 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-common-2:16.2.14-335.gd03fca4f.el8.x86_64 20/25 2023-12-06T15:22:46.417 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-common-2:16.2.14-335.gd03fca4f.el8.x86_64 20/25 2023-12-06T15:22:47.114 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-common-2:16.2.14-335.gd03fca4f.el8.x86_64 20/25 2023-12-06T15:22:47.421 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-base-2:16.2.14-335.gd03fca4f.el8.x86_64 21/25 2023-12-06T15:22:47.511 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-base-2:16.2.14-335.gd03fca4f.el8.x86_64 21/25 2023-12-06T15:22:47.692 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-selinux-2:16.2.14-335.gd03fca4f.el8.x86_64 22/25 2023-12-06T15:23:05.683 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-selinux-2:16.2.14-335.gd03fca4f.el8.x86_64 22/25 2023-12-06T15:23:05.683 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /sys 2023-12-06T15:23:05.683 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /proc 2023-12-06T15:23:05.684 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /dev 2023-12-06T15:23:05.684 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /run 2023-12-06T15:23:05.684 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /mnt 2023-12-06T15:23:05.684 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /var/tmp 2023-12-06T15:23:05.684 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /home 2023-12-06T15:23:05.684 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /tmp 2023-12-06T15:23:05.684 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /dev 2023-12-06T15:23:05.684 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:23:06.850 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-radosgw-2:16.2.14-335.gd03fca4f.el8.x86_64 23/25 2023-12-06T15:23:06.910 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-335.gd03fca4f.el8.x86_64 23/25 2023-12-06T15:23:06.910 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-06T15:23:07.132 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-06T15:23:07.132 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-06T15:23:07.766 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-06T15:23:07.767 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-base-2:16.2.14-335.gd03fca4f.el8.x86_64 1/25 2023-12-06T15:23:07.767 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-common-2:16.2.14-335.gd03fca4f.el8.x86_64 2/25 2023-12-06T15:23:07.767 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-radosgw-2:16.2.14-335.gd03fca4f.el8.x86_64 3/25 2023-12-06T15:23:07.767 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-selinux-2:16.2.14-335.gd03fca4f.el8.x86_64 4/25 2023-12-06T15:23:07.767 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephfs2-2:16.2.14-335.gd03fca4f.el8.x86_64 5/25 2023-12-06T15:23:07.767 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libradosstriper1-2:16.2.14-335.gd03fca4f.el8.x86_6 6/25 2023-12-06T15:23:07.767 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librgw2-2:16.2.14-335.gd03fca4f.el8.x86_64 7/25 2023-12-06T15:23:07.767 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ceph-argparse-2:16.2.14-335.gd03fca4f.el8. 8/25 2023-12-06T15:23:07.767 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ceph-common-2:16.2.14-335.gd03fca4f.el8.x8 9/25 2023-12-06T15:23:07.767 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cephfs-2:16.2.14-335.gd03fca4f.el8.x86_64 10/25 2023-12-06T15:23:07.767 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rados-2:16.2.14-335.gd03fca4f.el8.x86_64 11/25 2023-12-06T15:23:07.767 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rbd-2:16.2.14-335.gd03fca4f.el8.x86_64 12/25 2023-12-06T15:23:07.767 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rgw-2:16.2.14-335.gd03fca4f.el8.x86_64 13/25 2023-12-06T15:23:07.767 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2023-12-06T15:23:07.768 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-12-06T15:23:07.768 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-12-06T15:23:07.768 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 17/25 2023-12-06T15:23:07.768 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-12-06T15:23:07.768 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2023-12-06T15:23:07.768 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2023-12-06T15:23:07.768 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2023-12-06T15:23:07.768 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados2-2:16.2.14-335.gd03fca4f.el8.x86_64 22/25 2023-12-06T15:23:07.768 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-12-06T15:23:07.768 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librbd1-2:16.2.14-335.gd03fca4f.el8.x86_64 24/25 2023-12-06T15:23:08.913 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-12-06T15:23:08.913 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:23:08.914 INFO:teuthology.orchestra.run.smithi123.stdout:Upgraded: 2023-12-06T15:23:08.914 INFO:teuthology.orchestra.run.smithi123.stdout: librados2-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T15:23:08.914 INFO:teuthology.orchestra.run.smithi123.stdout: librbd1-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T15:23:08.914 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2023-12-06T15:23:08.914 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T15:23:08.914 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T15:23:08.914 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T15:23:08.914 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-selinux-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T15:23:08.914 INFO:teuthology.orchestra.run.smithi123.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-06T15:23:08.914 INFO:teuthology.orchestra.run.smithi123.stdout: leveldb-1.22-1.el8.x86_64 2023-12-06T15:23:08.914 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T15:23:08.914 INFO:teuthology.orchestra.run.smithi123.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-06T15:23:08.914 INFO:teuthology.orchestra.run.smithi123.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-06T15:23:08.914 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T15:23:08.915 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-06T15:23:08.915 INFO:teuthology.orchestra.run.smithi123.stdout: librgw2-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T15:23:08.915 INFO:teuthology.orchestra.run.smithi123.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-06T15:23:08.915 INFO:teuthology.orchestra.run.smithi123.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-06T15:23:08.915 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T15:23:08.915 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T15:23:08.915 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T15:23:08.915 INFO:teuthology.orchestra.run.smithi123.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-06T15:23:08.915 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T15:23:08.915 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T15:23:08.915 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T15:23:08.915 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:23:08.915 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2023-12-06T15:23:09.106 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-test 2023-12-06T15:23:09.938 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:00:41 ago on Wed 06 Dec 2023 03:22:28 PM UTC. 2023-12-06T15:23:11.601 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2023-12-06T15:23:11.602 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:23:11.602 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2023-12-06T15:23:11.603 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:23:11.603 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2023-12-06T15:23:11.603 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 52 M 2023-12-06T15:23:11.603 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2023-12-06T15:23:11.603 INFO:teuthology.orchestra.run.smithi123.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2023-12-06T15:23:11.603 INFO:teuthology.orchestra.run.smithi123.stdout: libcephsqlite x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 174 k 2023-12-06T15:23:11.603 INFO:teuthology.orchestra.run.smithi123.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-12-06T15:23:11.603 INFO:teuthology.orchestra.run.smithi123.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-12-06T15:23:11.603 INFO:teuthology.orchestra.run.smithi123.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-12-06T15:23:11.603 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:23:11.603 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2023-12-06T15:23:11.603 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:23:11.603 INFO:teuthology.orchestra.run.smithi123.stdout:Install 6 Packages 2023-12-06T15:23:11.603 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:23:11.604 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 53 M 2023-12-06T15:23:11.604 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 196 M 2023-12-06T15:23:11.604 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2023-12-06T15:23:11.942 INFO:teuthology.orchestra.run.smithi123.stdout:(1/6): jq-1.6-8.el8.x86_64.rpm 692 kB/s | 203 kB 00:00 2023-12-06T15:23:12.043 INFO:teuthology.orchestra.run.smithi123.stdout:(2/6): libcephsqlite-16.2.14-335.gd03fca4f.el8. 441 kB/s | 174 kB 00:00 2023-12-06T15:23:12.101 INFO:teuthology.orchestra.run.smithi123.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2023-12-06T15:23:12.193 INFO:teuthology.orchestra.run.smithi123.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 770 kB/s | 71 kB 00:00 2023-12-06T15:23:12.343 INFO:teuthology.orchestra.run.smithi123.stdout:(5/6): socat-1.7.4.1-1.el8.x86_64.rpm 1.0 MB/s | 323 kB 00:00 2023-12-06T15:23:14.085 INFO:teuthology.orchestra.run.smithi123.stdout:(6/6): ceph-test-16.2.14-335.gd03fca4f.el8.x86_ 21 MB/s | 52 MB 00:02 2023-12-06T15:23:14.087 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2023-12-06T15:23:14.087 INFO:teuthology.orchestra.run.smithi123.stdout:Total 21 MB/s | 53 MB 00:02 2023-12-06T15:23:14.129 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2023-12-06T15:23:14.152 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2023-12-06T15:23:14.152 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2023-12-06T15:23:14.483 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2023-12-06T15:23:14.486 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2023-12-06T15:23:14.955 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2023-12-06T15:23:15.200 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-12-06T15:23:15.389 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-12-06T15:23:15.512 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-06T15:23:15.612 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-06T15:23:15.808 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2023-12-06T15:23:15.945 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephsqlite-2:16.2.14-335.gd03fca4f.el8.x86_64 5/6 2023-12-06T15:23:20.536 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephsqlite-2:16.2.14-335.gd03fca4f.el8.x86_64 5/6 2023-12-06T15:23:20.793 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-test-2:16.2.14-335.gd03fca4f.el8.x86_64 6/6 2023-12-06T15:23:21.082 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-test-2:16.2.14-335.gd03fca4f.el8.x86_64 6/6 2023-12-06T15:23:21.083 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-test-2:16.2.14-335.gd03fca4f.el8.x86_64 1/6 2023-12-06T15:23:21.083 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephsqlite-2:16.2.14-335.gd03fca4f.el8.x86_64 2/6 2023-12-06T15:23:21.083 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2023-12-06T15:23:21.083 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-12-06T15:23:21.083 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-12-06T15:23:21.782 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-12-06T15:23:21.782 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:23:21.783 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2023-12-06T15:23:21.783 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T15:23:21.783 INFO:teuthology.orchestra.run.smithi123.stdout: jq-1.6-8.el8.x86_64 2023-12-06T15:23:21.783 INFO:teuthology.orchestra.run.smithi123.stdout: libcephsqlite-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T15:23:21.783 INFO:teuthology.orchestra.run.smithi123.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-06T15:23:21.783 INFO:teuthology.orchestra.run.smithi123.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-06T15:23:21.783 INFO:teuthology.orchestra.run.smithi123.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-06T15:23:21.783 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:23:21.783 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2023-12-06T15:23:22.026 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph 2023-12-06T15:23:22.875 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:00:54 ago on Wed 06 Dec 2023 03:22:28 PM UTC. 2023-12-06T15:23:24.534 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2023-12-06T15:23:24.538 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:23:24.538 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2023-12-06T15:23:24.538 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:23:24.538 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2023-12-06T15:23:24.538 INFO:teuthology.orchestra.run.smithi123.stdout: ceph x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 6.4 k 2023-12-06T15:23:24.538 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2023-12-06T15:23:24.538 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 2.4 M 2023-12-06T15:23:24.538 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 1.6 M 2023-12-06T15:23:24.538 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core noarch 2:16.2.14-335.gd03fca4f.el8 ceph-noarch 245 k 2023-12-06T15:23:24.538 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 5.0 M 2023-12-06T15:23:24.538 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 18 M 2023-12-06T15:23:24.539 INFO:teuthology.orchestra.run.smithi123.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-06T15:23:24.539 INFO:teuthology.orchestra.run.smithi123.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-06T15:23:24.539 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-12-06T15:23:24.539 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-06T15:23:24.539 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-06T15:23:24.539 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-12-06T15:23:24.539 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-06T15:23:24.539 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-06T15:23:24.539 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-06T15:23:24.539 INFO:teuthology.orchestra.run.smithi123.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-12-06T15:23:24.539 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-12-06T15:23:24.539 INFO:teuthology.orchestra.run.smithi123.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-06T15:23:24.539 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-06T15:23:24.539 INFO:teuthology.orchestra.run.smithi123.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-06T15:23:24.540 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-12-06T15:23:24.540 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-12-06T15:23:24.540 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-12-06T15:23:24.540 INFO:teuthology.orchestra.run.smithi123.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-06T15:23:24.540 INFO:teuthology.orchestra.run.smithi123.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-06T15:23:24.540 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-06T15:23:24.540 INFO:teuthology.orchestra.run.smithi123.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-06T15:23:24.540 INFO:teuthology.orchestra.run.smithi123.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-06T15:23:24.540 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-06T15:23:24.540 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-06T15:23:24.540 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-12-06T15:23:24.540 INFO:teuthology.orchestra.run.smithi123.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-06T15:23:24.540 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:23:24.540 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2023-12-06T15:23:24.540 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:23:24.541 INFO:teuthology.orchestra.run.smithi123.stdout:Install 32 Packages 2023-12-06T15:23:24.541 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:23:24.541 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 31 M 2023-12-06T15:23:24.541 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 101 M 2023-12-06T15:23:24.541 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2023-12-06T15:23:24.786 INFO:teuthology.orchestra.run.smithi123.stdout:(1/32): ceph-16.2.14-335.gd03fca4f.el8.x86_64.r 53 kB/s | 6.4 kB 00:00 2023-12-06T15:23:25.011 INFO:teuthology.orchestra.run.smithi123.stdout:(2/32): ceph-mds-16.2.14-335.gd03fca4f.el8.x86_ 7.1 MB/s | 2.4 MB 00:00 2023-12-06T15:23:25.066 INFO:teuthology.orchestra.run.smithi123.stdout:(3/32): ceph-mgr-16.2.14-335.gd03fca4f.el8.x86_ 4.1 MB/s | 1.6 MB 00:00 2023-12-06T15:23:25.895 INFO:teuthology.orchestra.run.smithi123.stdout:(4/32): ceph-osd-16.2.14-335.gd03fca4f.el8.x86_ 21 MB/s | 18 MB 00:00 2023-12-06T15:23:25.920 INFO:teuthology.orchestra.run.smithi123.stdout:(5/32): ceph-mgr-modules-core-16.2.14-335.gd03f 286 kB/s | 245 kB 00:00 2023-12-06T15:23:26.054 INFO:teuthology.orchestra.run.smithi123.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 291 kB/s | 39 kB 00:00 2023-12-06T15:23:26.104 INFO:teuthology.orchestra.run.smithi123.stdout:(7/32): python3-mako-1.0.6-14.el8.noarch.rpm 753 kB/s | 157 kB 00:00 2023-12-06T15:23:26.155 INFO:teuthology.orchestra.run.smithi123.stdout:(8/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 1.0 MB/s | 103 kB 00:00 2023-12-06T15:23:26.172 INFO:teuthology.orchestra.run.smithi123.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 849 kB/s | 57 kB 00:00 2023-12-06T15:23:26.255 INFO:teuthology.orchestra.run.smithi123.stdout:(10/32): ceph-mon-16.2.14-335.gd03fca4f.el8.x86 3.4 MB/s | 5.0 MB 00:01 2023-12-06T15:23:26.281 INFO:teuthology.orchestra.run.smithi123.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 3.6 MB/s | 457 kB 00:00 2023-12-06T15:23:26.656 INFO:teuthology.orchestra.run.smithi123.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 514 kB/s | 249 kB 00:00 2023-12-06T15:23:26.681 INFO:teuthology.orchestra.run.smithi123.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 272 kB/s | 109 kB 00:00 2023-12-06T15:23:26.874 INFO:teuthology.orchestra.run.smithi123.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 205 kB/s | 44 kB 00:00 2023-12-06T15:23:26.916 INFO:teuthology.orchestra.run.smithi123.stdout:(15/32): python3-cryptography-3.2.1-6.el8.x86_6 972 kB/s | 641 kB 00:00 2023-12-06T15:23:26.943 INFO:teuthology.orchestra.run.smithi123.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 716 kB/s | 185 kB 00:00 2023-12-06T15:23:26.999 INFO:teuthology.orchestra.run.smithi123.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 190 kB/s | 11 kB 00:00 2023-12-06T15:23:27.024 INFO:teuthology.orchestra.run.smithi123.stdout:(18/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.1 MB/s | 173 kB 00:00 2023-12-06T15:23:27.066 INFO:teuthology.orchestra.run.smithi123.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 263 kB/s | 18 kB 00:00 2023-12-06T15:23:27.091 INFO:teuthology.orchestra.run.smithi123.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 727 kB/s | 49 kB 00:00 2023-12-06T15:23:27.142 INFO:teuthology.orchestra.run.smithi123.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 779 kB/s | 59 kB 00:00 2023-12-06T15:23:27.192 INFO:teuthology.orchestra.run.smithi123.stdout:(22/32): python3-pecan-1.3.2-9.el8.noarch.rpm 2.8 MB/s | 283 kB 00:00 2023-12-06T15:23:27.218 INFO:teuthology.orchestra.run.smithi123.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 207 kB/s | 16 kB 00:00 2023-12-06T15:23:27.243 INFO:teuthology.orchestra.run.smithi123.stdout:(24/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.1 MB/s | 384 kB 00:00 2023-12-06T15:23:27.268 INFO:teuthology.orchestra.run.smithi123.stdout:(25/32): python3-simplegeneric-0.8.1-17.el8.noa 247 kB/s | 19 kB 00:00 2023-12-06T15:23:27.294 INFO:teuthology.orchestra.run.smithi123.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 316 kB/s | 24 kB 00:00 2023-12-06T15:23:27.344 INFO:teuthology.orchestra.run.smithi123.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 291 kB/s | 29 kB 00:00 2023-12-06T15:23:27.369 INFO:teuthology.orchestra.run.smithi123.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 274 kB/s | 27 kB 00:00 2023-12-06T15:23:27.402 INFO:teuthology.orchestra.run.smithi123.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 2.3 MB/s | 255 kB 00:00 2023-12-06T15:23:27.428 INFO:teuthology.orchestra.run.smithi123.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.9 MB/s | 251 kB 00:00 2023-12-06T15:23:27.453 INFO:teuthology.orchestra.run.smithi123.stdout:(31/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.0 MB/s | 85 kB 00:00 2023-12-06T15:23:27.478 INFO:teuthology.orchestra.run.smithi123.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 305 kB/s | 23 kB 00:00 2023-12-06T15:23:27.480 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2023-12-06T15:23:27.480 INFO:teuthology.orchestra.run.smithi123.stdout:Total 11 MB/s | 31 MB 00:02 2023-12-06T15:23:27.568 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2023-12-06T15:23:27.607 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2023-12-06T15:23:27.608 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2023-12-06T15:23:27.910 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2023-12-06T15:23:27.914 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2023-12-06T15:23:29.059 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2023-12-06T15:23:29.281 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-12-06T15:23:29.459 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-12-06T15:23:29.676 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-12-06T15:23:29.921 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2023-12-06T15:23:30.122 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-12-06T15:23:30.285 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-12-06T15:23:30.462 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-12-06T15:23:30.682 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-12-06T15:23:30.882 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-12-06T15:23:31.119 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-12-06T15:23:31.315 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-12-06T15:23:31.555 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-12-06T15:23:31.926 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2023-12-06T15:23:32.203 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/32 2023-12-06T15:23:32.417 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-12-06T15:23:32.624 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-12-06T15:23:32.843 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-06T15:23:33.142 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-12-06T15:23:33.348 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-12-06T15:23:33.544 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2023-12-06T15:23:33.714 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-12-06T15:23:34.030 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-12-06T15:23:34.246 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-12-06T15:23:34.464 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-12-06T15:23:34.801 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2023-12-06T15:23:35.094 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-12-06T15:23:35.457 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-335.gd03fca4f.el8. 27/32 2023-12-06T15:23:35.663 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-2:16.2.14-335.gd03fca4f.el8.x86_64 28/32 2023-12-06T15:23:37.153 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-2:16.2.14-335.gd03fca4f.el8.x86_64 28/32 2023-12-06T15:23:37.301 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-osd-2:16.2.14-335.gd03fca4f.el8.x86_64 29/32 2023-12-06T15:23:37.964 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-osd-2:16.2.14-335.gd03fca4f.el8.x86_64 29/32 2023-12-06T15:23:37.965 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mon-2:16.2.14-335.gd03fca4f.el8.x86_64 30/32 2023-12-06T15:23:38.141 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mon-2:16.2.14-335.gd03fca4f.el8.x86_64 30/32 2023-12-06T15:23:38.317 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mds-2:16.2.14-335.gd03fca4f.el8.x86_64 31/32 2023-12-06T15:23:38.334 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mds-2:16.2.14-335.gd03fca4f.el8.x86_64 31/32 2023-12-06T15:23:38.441 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-2:16.2.14-335.gd03fca4f.el8.x86_64 32/32 2023-12-06T15:23:38.840 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-2:16.2.14-335.gd03fca4f.el8.x86_64 32/32 2023-12-06T15:23:38.840 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-2:16.2.14-335.gd03fca4f.el8.x86_64 1/32 2023-12-06T15:23:38.841 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mds-2:16.2.14-335.gd03fca4f.el8.x86_64 2/32 2023-12-06T15:23:38.841 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-2:16.2.14-335.gd03fca4f.el8.x86_64 3/32 2023-12-06T15:23:38.841 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mon-2:16.2.14-335.gd03fca4f.el8.x86_64 4/32 2023-12-06T15:23:38.841 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-osd-2:16.2.14-335.gd03fca4f.el8.x86_64 5/32 2023-12-06T15:23:38.841 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-335.gd03fca4f.el8. 6/32 2023-12-06T15:23:38.841 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2023-12-06T15:23:38.841 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-12-06T15:23:38.841 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-12-06T15:23:38.841 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2023-12-06T15:23:38.841 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-12-06T15:23:38.841 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2023-12-06T15:23:38.841 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 13/32 2023-12-06T15:23:38.841 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-12-06T15:23:38.842 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-12-06T15:23:38.842 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-12-06T15:23:38.842 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-06T15:23:38.842 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-12-06T15:23:38.842 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-12-06T15:23:38.842 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-12-06T15:23:38.842 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-12-06T15:23:38.842 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-12-06T15:23:38.842 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-12-06T15:23:38.842 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-12-06T15:23:38.842 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-12-06T15:23:38.842 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-12-06T15:23:38.843 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-12-06T15:23:38.843 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-12-06T15:23:38.843 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2023-12-06T15:23:38.843 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-12-06T15:23:38.843 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-12-06T15:23:40.072 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-12-06T15:23:40.072 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:23:40.072 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2023-12-06T15:23:40.072 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T15:23:40.073 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T15:23:40.073 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T15:23:40.073 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core-2:16.2.14-335.gd03fca4f.el8.noarch 2023-12-06T15:23:40.073 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T15:23:40.073 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T15:23:40.073 INFO:teuthology.orchestra.run.smithi123.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-06T15:23:40.073 INFO:teuthology.orchestra.run.smithi123.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-06T15:23:40.073 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-06T15:23:40.073 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-06T15:23:40.073 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-06T15:23:40.073 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-06T15:23:40.073 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-06T15:23:40.073 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-06T15:23:40.074 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-06T15:23:40.074 INFO:teuthology.orchestra.run.smithi123.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-06T15:23:40.074 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-06T15:23:40.074 INFO:teuthology.orchestra.run.smithi123.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-06T15:23:40.074 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-06T15:23:40.074 INFO:teuthology.orchestra.run.smithi123.stdout: python3-portend-2.6-1.el8.noarch 2023-12-06T15:23:40.074 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-06T15:23:40.074 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-06T15:23:40.074 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-06T15:23:40.074 INFO:teuthology.orchestra.run.smithi123.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-06T15:23:40.074 INFO:teuthology.orchestra.run.smithi123.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-06T15:23:40.075 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-06T15:23:40.075 INFO:teuthology.orchestra.run.smithi123.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-06T15:23:40.075 INFO:teuthology.orchestra.run.smithi123.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-06T15:23:40.075 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-06T15:23:40.075 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-06T15:23:40.075 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-06T15:23:40.075 INFO:teuthology.orchestra.run.smithi123.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-06T15:23:40.075 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:23:40.075 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2023-12-06T15:23:40.284 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-base 2023-12-06T15:23:41.134 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:13 ago on Wed 06 Dec 2023 03:22:28 PM UTC. 2023-12-06T15:23:42.600 INFO:teuthology.orchestra.run.smithi123.stdout:Package ceph-base-2:16.2.14-335.gd03fca4f.el8.x86_64 is already installed. 2023-12-06T15:23:42.821 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2023-12-06T15:23:42.822 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2023-12-06T15:23:42.822 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2023-12-06T15:23:42.938 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install cephadm 2023-12-06T15:23:43.774 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:15 ago on Wed 06 Dec 2023 03:22:28 PM UTC. 2023-12-06T15:23:45.436 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2023-12-06T15:23:45.437 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:23:45.437 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2023-12-06T15:23:45.437 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:23:45.437 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2023-12-06T15:23:45.437 INFO:teuthology.orchestra.run.smithi123.stdout: cephadm noarch 2:16.2.14-335.gd03fca4f.el8 ceph-noarch 85 k 2023-12-06T15:23:45.437 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:23:45.437 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2023-12-06T15:23:45.437 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:23:45.437 INFO:teuthology.orchestra.run.smithi123.stdout:Install 1 Package 2023-12-06T15:23:45.437 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:23:45.438 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 85 k 2023-12-06T15:23:45.438 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 352 k 2023-12-06T15:23:45.438 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2023-12-06T15:23:45.929 INFO:teuthology.orchestra.run.smithi123.stdout:cephadm-16.2.14-335.gd03fca4f.el8.noarch.rpm 174 kB/s | 85 kB 00:00 2023-12-06T15:23:45.929 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2023-12-06T15:23:45.929 INFO:teuthology.orchestra.run.smithi123.stdout:Total 173 kB/s | 85 kB 00:00 2023-12-06T15:23:45.929 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2023-12-06T15:23:45.936 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2023-12-06T15:23:45.936 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2023-12-06T15:23:45.938 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2023-12-06T15:23:45.941 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2023-12-06T15:23:46.033 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2023-12-06T15:23:46.553 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: cephadm-2:16.2.14-335.gd03fca4f.el8.noarch 1/1 2023-12-06T15:23:46.691 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephadm-2:16.2.14-335.gd03fca4f.el8.noarch 1/1 2023-12-06T15:23:46.917 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: cephadm-2:16.2.14-335.gd03fca4f.el8.noarch 1/1 2023-12-06T15:23:47.595 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephadm-2:16.2.14-335.gd03fca4f.el8.noarch 1/1 2023-12-06T15:23:47.596 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:23:47.596 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2023-12-06T15:23:47.596 INFO:teuthology.orchestra.run.smithi123.stdout: cephadm-2:16.2.14-335.gd03fca4f.el8.noarch 2023-12-06T15:23:47.596 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:23:47.596 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2023-12-06T15:23:47.794 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-immutable-object-cache 2023-12-06T15:23:48.654 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:20 ago on Wed 06 Dec 2023 03:22:28 PM UTC. 2023-12-06T15:23:50.314 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2023-12-06T15:23:50.315 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:23:50.315 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repo Size 2023-12-06T15:23:50.315 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:23:50.316 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2023-12-06T15:23:50.316 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 161 k 2023-12-06T15:23:50.316 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:23:50.316 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2023-12-06T15:23:50.316 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:23:50.316 INFO:teuthology.orchestra.run.smithi123.stdout:Install 1 Package 2023-12-06T15:23:50.316 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:23:50.316 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 161 k 2023-12-06T15:23:50.316 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 470 k 2023-12-06T15:23:50.316 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2023-12-06T15:23:50.644 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-immutable-object-cache-16.2.14-335.gd03fca 491 kB/s | 161 kB 00:00 2023-12-06T15:23:50.645 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2023-12-06T15:23:50.645 INFO:teuthology.orchestra.run.smithi123.stdout:Total 489 kB/s | 161 kB 00:00 2023-12-06T15:23:50.645 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2023-12-06T15:23:50.656 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2023-12-06T15:23:50.656 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2023-12-06T15:23:50.703 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2023-12-06T15:23:50.706 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2023-12-06T15:23:50.821 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2023-12-06T15:23:50.973 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-immutable-object-cache-2:16.2.14-335.gd03fca4f. 1/1 2023-12-06T15:23:51.956 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.14-335.gd03fca4f. 1/1 2023-12-06T15:23:53.372 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-immutable-object-cache-2:16.2.14-335.gd03fca4f. 1/1 2023-12-06T15:23:53.372 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:23:53.372 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2023-12-06T15:23:53.372 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T15:23:53.372 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:23:53.372 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2023-12-06T15:23:53.603 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-mgr 2023-12-06T15:23:54.466 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:26 ago on Wed 06 Dec 2023 03:22:28 PM UTC. 2023-12-06T15:23:55.923 INFO:teuthology.orchestra.run.smithi123.stdout:Package ceph-mgr-2:16.2.14-335.gd03fca4f.el8.x86_64 is already installed. 2023-12-06T15:23:56.148 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2023-12-06T15:23:56.149 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2023-12-06T15:23:56.149 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2023-12-06T15:23:56.259 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-mgr-dashboard 2023-12-06T15:23:57.100 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:29 ago on Wed 06 Dec 2023 03:22:28 PM UTC. 2023-12-06T15:23:58.776 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2023-12-06T15:23:58.777 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:23:58.777 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2023-12-06T15:23:58.777 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:23:58.777 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2023-12-06T15:23:58.777 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard noarch 2:16.2.14-335.gd03fca4f.el8 ceph-noarch 3.1 M 2023-12-06T15:23:58.778 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2023-12-06T15:23:58.778 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-grafana-dashboards noarch 2:16.2.14-335.gd03fca4f.el8 ceph-noarch 24 k 2023-12-06T15:23:58.778 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-prometheus-alerts noarch 2:16.2.14-335.gd03fca4f.el8 ceph-noarch 15 k 2023-12-06T15:23:58.778 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-12-06T15:23:58.778 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-06T15:23:58.778 INFO:teuthology.orchestra.run.smithi123.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-06T15:23:58.778 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:23:58.778 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2023-12-06T15:23:58.778 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:23:58.778 INFO:teuthology.orchestra.run.smithi123.stdout:Install 6 Packages 2023-12-06T15:23:58.778 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:23:58.779 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 3.4 M 2023-12-06T15:23:58.779 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 22 M 2023-12-06T15:23:58.779 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2023-12-06T15:23:59.206 INFO:teuthology.orchestra.run.smithi123.stdout:(1/6): ceph-prometheus-alerts-16.2.14-335.gd03f 87 kB/s | 15 kB 00:00 2023-12-06T15:23:59.231 INFO:teuthology.orchestra.run.smithi123.stdout:(2/6): ceph-grafana-dashboards-16.2.14-335.gd03 125 kB/s | 24 kB 00:00 2023-12-06T15:23:59.407 INFO:teuthology.orchestra.run.smithi123.stdout:(3/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 192 kB/s | 34 kB 00:00 2023-12-06T15:23:59.641 INFO:teuthology.orchestra.run.smithi123.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 98 kB/s | 43 kB 00:00 2023-12-06T15:23:59.666 INFO:teuthology.orchestra.run.smithi123.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 760 kB/s | 196 kB 00:00 2023-12-06T15:24:00.224 INFO:teuthology.orchestra.run.smithi123.stdout:(6/6): ceph-mgr-dashboard-16.2.14-335.gd03fca4f 2.6 MB/s | 3.1 MB 00:01 2023-12-06T15:24:00.226 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2023-12-06T15:24:00.226 INFO:teuthology.orchestra.run.smithi123.stdout:Total 2.4 MB/s | 3.4 MB 00:01 2023-12-06T15:24:00.237 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2023-12-06T15:24:00.248 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2023-12-06T15:24:00.248 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2023-12-06T15:24:00.412 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2023-12-06T15:24:00.416 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2023-12-06T15:24:00.707 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2023-12-06T15:24:00.868 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-12-06T15:24:01.097 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-12-06T15:24:01.248 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-12-06T15:24:01.385 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-335.gd03fca4f.el8.n 4/6 2023-12-06T15:24:02.405 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-335.gd03fca4f.el8. 5/6 2023-12-06T15:24:02.658 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-335.gd03fca4f.el8.noarc 6/6 2023-12-06T15:24:02.925 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-335.gd03fca4f.el8.noarc 6/6 2023-12-06T15:24:02.925 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-335.gd03fca4f.el8. 1/6 2023-12-06T15:24:02.925 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-335.gd03fca4f.el8.noarc 2/6 2023-12-06T15:24:02.925 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-335.gd03fca4f.el8.n 3/6 2023-12-06T15:24:02.926 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-12-06T15:24:02.926 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-12-06T15:24:03.636 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-12-06T15:24:03.637 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:24:03.637 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2023-12-06T15:24:03.637 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-grafana-dashboards-2:16.2.14-335.gd03fca4f.el8.noarch 2023-12-06T15:24:03.637 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard-2:16.2.14-335.gd03fca4f.el8.noarch 2023-12-06T15:24:03.637 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-prometheus-alerts-2:16.2.14-335.gd03fca4f.el8.noarch 2023-12-06T15:24:03.637 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-06T15:24:03.637 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-06T15:24:03.637 INFO:teuthology.orchestra.run.smithi123.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-06T15:24:03.637 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:24:03.637 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2023-12-06T15:24:03.795 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-06T15:24:04.642 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:36 ago on Wed 06 Dec 2023 03:22:28 PM UTC. 2023-12-06T15:24:06.303 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2023-12-06T15:24:06.304 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================================ 2023-12-06T15:24:06.304 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2023-12-06T15:24:06.304 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================================ 2023-12-06T15:24:06.305 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2023-12-06T15:24:06.305 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-335.gd03fca4f.el8 ceph-noarch 8.6 M 2023-12-06T15:24:06.305 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2023-12-06T15:24:06.305 INFO:teuthology.orchestra.run.smithi123.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2023-12-06T15:24:06.305 INFO:teuthology.orchestra.run.smithi123.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2023-12-06T15:24:06.305 INFO:teuthology.orchestra.run.smithi123.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-12-06T15:24:06.305 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-12-06T15:24:06.305 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-12-06T15:24:06.305 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-12-06T15:24:06.305 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-12-06T15:24:06.305 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:24:06.305 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2023-12-06T15:24:06.305 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================================ 2023-12-06T15:24:06.305 INFO:teuthology.orchestra.run.smithi123.stdout:Install 8 Packages 2023-12-06T15:24:06.305 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:24:06.306 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 37 M 2023-12-06T15:24:06.306 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 210 M 2023-12-06T15:24:06.306 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2023-12-06T15:24:07.379 INFO:teuthology.orchestra.run.smithi123.stdout:(1/8): openblas-0.3.15-4.el8.x86_64.rpm 6.1 MB/s | 4.7 MB 00:00 2023-12-06T15:24:07.445 INFO:teuthology.orchestra.run.smithi123.stdout:(2/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 5.7 MB/s | 4.9 MB 00:00 2023-12-06T15:24:07.512 INFO:teuthology.orchestra.run.smithi123.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 3.3 MB/s | 225 kB 00:00 2023-12-06T15:24:07.746 INFO:teuthology.orchestra.run.smithi123.stdout:(4/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 10 MB/s | 3.7 MB 00:00 2023-12-06T15:24:08.338 INFO:teuthology.orchestra.run.smithi123.stdout:(5/8): python3-scipy-1.0.0-21.module_el8.5.0+77 17 MB/s | 14 MB 00:00 2023-12-06T15:24:08.530 INFO:teuthology.orchestra.run.smithi123.stdout:(6/8): libgfortran-8.5.0-21.el8.x86_64.rpm 824 kB/s | 645 kB 00:00 2023-12-06T15:24:08.706 INFO:teuthology.orchestra.run.smithi123.stdout:(7/8): ceph-mgr-diskprediction-local-16.2.14-33 4.1 MB/s | 8.6 MB 00:02 2023-12-06T15:24:08.807 INFO:teuthology.orchestra.run.smithi123.stdout:(8/8): libquadmath-8.5.0-21.el8.x86_64.rpm 431 kB/s | 172 kB 00:00 2023-12-06T15:24:08.807 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2023-12-06T15:24:08.807 INFO:teuthology.orchestra.run.smithi123.stdout:Total 15 MB/s | 37 MB 00:02 2023-12-06T15:24:08.975 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2023-12-06T15:24:08.990 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2023-12-06T15:24:09.001 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2023-12-06T15:24:09.360 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2023-12-06T15:24:09.371 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2023-12-06T15:24:10.191 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2023-12-06T15:24:10.329 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-06T15:24:10.442 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-06T15:24:10.611 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-06T15:24:11.213 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-06T15:24:11.394 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-12-06T15:24:12.031 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-12-06T15:24:12.178 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-06T15:24:12.876 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-06T15:24:13.189 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-12-06T15:24:13.491 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-06T15:24:15.250 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-06T15:24:16.508 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-12-06T15:24:16.718 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-335.gd03fca4 8/8 2023-12-06T15:24:17.025 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-335.gd03fca4 8/8 2023-12-06T15:24:17.025 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-335.gd03fca4 1/8 2023-12-06T15:24:17.025 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-12-06T15:24:17.025 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-12-06T15:24:17.025 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-12-06T15:24:17.025 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-12-06T15:24:17.025 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-12-06T15:24:17.025 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2023-12-06T15:24:17.746 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2023-12-06T15:24:17.746 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:24:17.746 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2023-12-06T15:24:17.746 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-diskprediction-local-2:16.2.14-335.gd03fca4f.el8.noarch 2023-12-06T15:24:17.746 INFO:teuthology.orchestra.run.smithi123.stdout: libgfortran-8.5.0-21.el8.x86_64 2023-12-06T15:24:17.746 INFO:teuthology.orchestra.run.smithi123.stdout: libquadmath-8.5.0-21.el8.x86_64 2023-12-06T15:24:17.746 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-0.3.15-4.el8.x86_64 2023-12-06T15:24:17.746 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-12-06T15:24:17.746 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-06T15:24:17.746 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-06T15:24:17.747 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-12-06T15:24:17.747 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:24:17.747 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2023-12-06T15:24:17.904 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-mgr-rook 2023-12-06T15:24:18.757 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:50 ago on Wed 06 Dec 2023 03:22:28 PM UTC. 2023-12-06T15:24:20.440 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2023-12-06T15:24:20.442 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:24:20.442 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2023-12-06T15:24:20.442 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:24:20.442 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2023-12-06T15:24:20.442 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-rook noarch 2:16.2.14-335.gd03fca4f.el8 ceph-noarch 27 k 2023-12-06T15:24:20.442 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2023-12-06T15:24:20.442 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-06T15:24:20.442 INFO:teuthology.orchestra.run.smithi123.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-06T15:24:20.442 INFO:teuthology.orchestra.run.smithi123.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-06T15:24:20.442 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-12-06T15:24:20.442 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-12-06T15:24:20.442 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-06T15:24:20.442 INFO:teuthology.orchestra.run.smithi123.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-12-06T15:24:20.443 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-12-06T15:24:20.443 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-12-06T15:24:20.443 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-12-06T15:24:20.443 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-06T15:24:20.443 INFO:teuthology.orchestra.run.smithi123.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-06T15:24:20.443 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:24:20.443 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2023-12-06T15:24:20.443 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:24:20.443 INFO:teuthology.orchestra.run.smithi123.stdout:Install 13 Packages 2023-12-06T15:24:20.443 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:24:20.444 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 1.9 M 2023-12-06T15:24:20.444 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 24 M 2023-12-06T15:24:20.444 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2023-12-06T15:24:20.930 INFO:teuthology.orchestra.run.smithi123.stdout:(1/13): python3-jsonpointer-1.10-11.el8.noarch. 86 kB/s | 20 kB 00:00 2023-12-06T15:24:20.955 INFO:teuthology.orchestra.run.smithi123.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 103 kB/s | 27 kB 00:00 2023-12-06T15:24:21.089 INFO:teuthology.orchestra.run.smithi123.stdout:(3/13): ceph-mgr-rook-16.2.14-335.gd03fca4f.el8 70 kB/s | 27 kB 00:00 2023-12-06T15:24:21.173 INFO:teuthology.orchestra.run.smithi123.stdout:(4/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 521 kB/s | 126 kB 00:00 2023-12-06T15:24:21.198 INFO:teuthology.orchestra.run.smithi123.stdout:(5/13): python3-pyasn1-modules-0.3.7-6.el8.noar 454 kB/s | 110 kB 00:00 2023-12-06T15:24:21.348 INFO:teuthology.orchestra.run.smithi123.stdout:(6/13): python3-cachetools-3.1.1-4.el8.noarch.r 220 kB/s | 33 kB 00:00 2023-12-06T15:24:21.399 INFO:teuthology.orchestra.run.smithi123.stdout:(7/13): python3-certifi-2018.10.15-7.el8.noarch 326 kB/s | 16 kB 00:00 2023-12-06T15:24:21.474 INFO:teuthology.orchestra.run.smithi123.stdout:(8/13): python3-google-auth-1.1.1-10.el8.noarch 1.1 MB/s | 81 kB 00:00 2023-12-06T15:24:21.499 INFO:teuthology.orchestra.run.smithi123.stdout:(9/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 378 kB/s | 155 kB 00:00 2023-12-06T15:24:21.524 INFO:teuthology.orchestra.run.smithi123.stdout:(10/13): python3-requests-oauthlib-1.0.0-1.el8. 121 kB/s | 43 kB 00:00 2023-12-06T15:24:21.658 INFO:teuthology.orchestra.run.smithi123.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 405 kB/s | 64 kB 00:00 2023-12-06T15:24:21.683 INFO:teuthology.orchestra.run.smithi123.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 399 kB/s | 61 kB 00:00 2023-12-06T15:24:21.775 INFO:teuthology.orchestra.run.smithi123.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 3.9 MB/s | 1.2 MB 00:00 2023-12-06T15:24:21.778 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2023-12-06T15:24:21.778 INFO:teuthology.orchestra.run.smithi123.stdout:Total 1.4 MB/s | 1.9 MB 00:01 2023-12-06T15:24:21.841 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2023-12-06T15:24:21.858 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2023-12-06T15:24:21.858 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2023-12-06T15:24:21.953 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2023-12-06T15:24:21.956 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2023-12-06T15:24:22.482 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2023-12-06T15:24:22.729 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-12-06T15:24:22.951 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-12-06T15:24:23.145 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2023-12-06T15:24:23.415 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-12-06T15:24:23.627 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-12-06T15:24:23.879 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-12-06T15:24:24.146 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-12-06T15:24:24.412 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-12-06T15:24:25.430 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-12-06T15:24:25.715 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-12-06T15:24:25.892 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-12-06T15:24:26.091 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-12-06T15:24:26.272 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-rook-2:16.2.14-335.gd03fca4f.el8.noarch 13/13 2023-12-06T15:24:26.577 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-335.gd03fca4f.el8.noarch 13/13 2023-12-06T15:24:26.578 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-rook-2:16.2.14-335.gd03fca4f.el8.noarch 1/13 2023-12-06T15:24:26.578 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-12-06T15:24:26.578 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-12-06T15:24:26.578 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-12-06T15:24:26.578 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-12-06T15:24:26.578 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-12-06T15:24:26.578 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-12-06T15:24:26.578 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-12-06T15:24:26.578 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-12-06T15:24:26.578 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-12-06T15:24:26.578 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-12-06T15:24:26.578 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2023-12-06T15:24:27.343 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-12-06T15:24:27.343 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:24:27.343 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2023-12-06T15:24:27.343 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-rook-2:16.2.14-335.gd03fca4f.el8.noarch 2023-12-06T15:24:27.343 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-06T15:24:27.343 INFO:teuthology.orchestra.run.smithi123.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-06T15:24:27.343 INFO:teuthology.orchestra.run.smithi123.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-06T15:24:27.343 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-06T15:24:27.343 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-06T15:24:27.344 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-06T15:24:27.344 INFO:teuthology.orchestra.run.smithi123.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-06T15:24:27.344 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-06T15:24:27.344 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-06T15:24:27.344 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-06T15:24:27.344 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-06T15:24:27.344 INFO:teuthology.orchestra.run.smithi123.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-06T15:24:27.344 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:24:27.344 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2023-12-06T15:24:27.493 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-mgr-cephadm 2023-12-06T15:24:28.346 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:02:00 ago on Wed 06 Dec 2023 03:22:28 PM UTC. 2023-12-06T15:24:30.011 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2023-12-06T15:24:30.012 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:24:30.013 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2023-12-06T15:24:30.013 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:24:30.013 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2023-12-06T15:24:30.013 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-cephadm noarch 2:16.2.14-335.gd03fca4f.el8 ceph-noarch 116 k 2023-12-06T15:24:30.013 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2023-12-06T15:24:30.013 INFO:teuthology.orchestra.run.smithi123.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2023-12-06T15:24:30.013 INFO:teuthology.orchestra.run.smithi123.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-12-06T15:24:30.013 INFO:teuthology.orchestra.run.smithi123.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2023-12-06T15:24:30.013 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-12-06T15:24:30.013 INFO:teuthology.orchestra.run.smithi123.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2023-12-06T15:24:30.013 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:24:30.013 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2023-12-06T15:24:30.014 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:24:30.014 INFO:teuthology.orchestra.run.smithi123.stdout:Install 6 Packages 2023-12-06T15:24:30.014 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:24:30.014 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 5.8 M 2023-12-06T15:24:30.014 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 24 M 2023-12-06T15:24:30.014 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2023-12-06T15:24:30.482 INFO:teuthology.orchestra.run.smithi123.stdout:(1/6): ceph-mgr-cephadm-16.2.14-335.gd03fca4f.e 576 kB/s | 116 kB 00:00 2023-12-06T15:24:30.791 INFO:teuthology.orchestra.run.smithi123.stdout:(2/6): python3-jinja2-2.10.1-3.el8.noarch.rpm 1.0 MB/s | 538 kB 00:00 2023-12-06T15:24:30.875 INFO:teuthology.orchestra.run.smithi123.stdout:(3/6): python3-apipkg-1.5-6.el8.noarch.rpm 54 kB/s | 21 kB 00:00 2023-12-06T15:24:31.083 INFO:teuthology.orchestra.run.smithi123.stdout:(4/6): python3-remoto-1.2.1-1.el8.noarch.rpm 239 kB/s | 49 kB 00:00 2023-12-06T15:24:31.448 INFO:teuthology.orchestra.run.smithi123.stdout:(5/6): python3-execnet-1.7.1-1.el8.noarch.rpm 541 kB/s | 355 kB 00:00 2023-12-06T15:24:31.801 INFO:teuthology.orchestra.run.smithi123.stdout:(6/6): python3-babel-2.5.1-7.el8.noarch.rpm 3.2 MB/s | 4.8 MB 00:01 2023-12-06T15:24:31.803 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2023-12-06T15:24:31.804 INFO:teuthology.orchestra.run.smithi123.stdout:Total 3.3 MB/s | 5.8 MB 00:01 2023-12-06T15:24:31.858 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2023-12-06T15:24:31.868 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2023-12-06T15:24:31.868 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2023-12-06T15:24:31.974 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2023-12-06T15:24:31.977 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2023-12-06T15:24:32.311 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2023-12-06T15:24:32.607 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2023-12-06T15:24:32.877 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2023-12-06T15:24:33.793 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2023-12-06T15:24:34.111 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 4/6 2023-12-06T15:24:34.374 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 5/6 2023-12-06T15:24:34.557 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-cephadm-2:16.2.14-335.gd03fca4f.el8.noarch 6/6 2023-12-06T15:24:34.872 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.14-335.gd03fca4f.el8.noarch 6/6 2023-12-06T15:24:34.872 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-cephadm-2:16.2.14-335.gd03fca4f.el8.noarch 1/6 2023-12-06T15:24:34.872 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/6 2023-12-06T15:24:34.872 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/6 2023-12-06T15:24:34.873 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2023-12-06T15:24:34.873 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2023-12-06T15:24:35.704 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2023-12-06T15:24:35.704 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:24:35.704 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2023-12-06T15:24:35.704 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-cephadm-2:16.2.14-335.gd03fca4f.el8.noarch 2023-12-06T15:24:35.704 INFO:teuthology.orchestra.run.smithi123.stdout: python3-apipkg-1.5-6.el8.noarch 2023-12-06T15:24:35.704 INFO:teuthology.orchestra.run.smithi123.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-06T15:24:35.705 INFO:teuthology.orchestra.run.smithi123.stdout: python3-execnet-1.7.1-1.el8.noarch 2023-12-06T15:24:35.705 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-06T15:24:35.705 INFO:teuthology.orchestra.run.smithi123.stdout: python3-remoto-1.2.1-1.el8.noarch 2023-12-06T15:24:35.705 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:24:35.705 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2023-12-06T15:24:35.816 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-fuse 2023-12-06T15:24:36.671 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:02:08 ago on Wed 06 Dec 2023 03:22:28 PM UTC. 2023-12-06T15:24:38.384 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2023-12-06T15:24:38.385 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:24:38.385 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2023-12-06T15:24:38.385 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:24:38.385 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2023-12-06T15:24:38.385 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 910 k 2023-12-06T15:24:38.385 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2023-12-06T15:24:38.385 INFO:teuthology.orchestra.run.smithi123.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-12-06T15:24:38.385 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:24:38.385 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2023-12-06T15:24:38.386 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:24:38.386 INFO:teuthology.orchestra.run.smithi123.stdout:Install 2 Packages 2023-12-06T15:24:38.386 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:24:38.386 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 993 k 2023-12-06T15:24:38.386 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 2.8 M 2023-12-06T15:24:38.386 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2023-12-06T15:24:39.110 INFO:teuthology.orchestra.run.smithi123.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 158 kB/s | 83 kB 00:00 2023-12-06T15:24:39.327 INFO:teuthology.orchestra.run.smithi123.stdout:(2/2): ceph-fuse-16.2.14-335.gd03fca4f.el8.x86_ 1.2 MB/s | 910 kB 00:00 2023-12-06T15:24:39.328 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2023-12-06T15:24:39.328 INFO:teuthology.orchestra.run.smithi123.stdout:Total 1.0 MB/s | 993 kB 00:00 2023-12-06T15:24:39.339 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2023-12-06T15:24:39.361 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2023-12-06T15:24:39.361 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2023-12-06T15:24:39.451 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2023-12-06T15:24:39.454 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2023-12-06T15:24:39.611 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2023-12-06T15:24:39.880 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-12-06T15:24:40.106 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-fuse-2:16.2.14-335.gd03fca4f.el8.x86_64 2/2 2023-12-06T15:24:40.482 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-fuse-2:16.2.14-335.gd03fca4f.el8.x86_64 2/2 2023-12-06T15:24:40.482 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-fuse-2:16.2.14-335.gd03fca4f.el8.x86_64 1/2 2023-12-06T15:24:41.211 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-12-06T15:24:41.212 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:24:41.212 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2023-12-06T15:24:41.212 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse-2:16.2.14-335.gd03fca4f.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-12-06T15:24:41.212 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:24:41.212 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2023-12-06T15:24:41.457 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install librados-devel 2023-12-06T15:24:42.322 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:02:14 ago on Wed 06 Dec 2023 03:22:28 PM UTC. 2023-12-06T15:24:43.994 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2023-12-06T15:24:43.995 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:24:43.995 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repo Size 2023-12-06T15:24:43.995 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:24:43.995 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2023-12-06T15:24:43.995 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 131 k 2023-12-06T15:24:43.995 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:24:43.995 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2023-12-06T15:24:43.995 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:24:43.995 INFO:teuthology.orchestra.run.smithi123.stdout:Install 1 Package 2023-12-06T15:24:43.995 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:24:43.996 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 131 k 2023-12-06T15:24:43.996 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 432 k 2023-12-06T15:24:43.996 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2023-12-06T15:24:44.339 INFO:teuthology.orchestra.run.smithi123.stdout:librados-devel-16.2.14-335.gd03fca4f.el8.x86_64 383 kB/s | 131 kB 00:00 2023-12-06T15:24:44.339 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2023-12-06T15:24:44.339 INFO:teuthology.orchestra.run.smithi123.stdout:Total 381 kB/s | 131 kB 00:00 2023-12-06T15:24:44.340 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2023-12-06T15:24:44.345 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2023-12-06T15:24:44.345 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2023-12-06T15:24:44.396 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2023-12-06T15:24:44.399 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2023-12-06T15:24:44.517 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2023-12-06T15:24:44.771 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librados-devel-2:16.2.14-335.gd03fca4f.el8.x86_64 1/1 2023-12-06T15:24:45.050 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados-devel-2:16.2.14-335.gd03fca4f.el8.x86_64 1/1 2023-12-06T15:24:45.755 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados-devel-2:16.2.14-335.gd03fca4f.el8.x86_64 1/1 2023-12-06T15:24:45.756 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:24:45.756 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2023-12-06T15:24:45.756 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T15:24:45.756 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:24:45.756 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2023-12-06T15:24:46.840 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install libcephfs2 2023-12-06T15:24:47.698 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:02:19 ago on Wed 06 Dec 2023 03:22:28 PM UTC. 2023-12-06T15:24:49.164 INFO:teuthology.orchestra.run.smithi123.stdout:Package libcephfs2-2:16.2.14-335.gd03fca4f.el8.x86_64 is already installed. 2023-12-06T15:24:49.386 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2023-12-06T15:24:49.387 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2023-12-06T15:24:49.387 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2023-12-06T15:24:49.484 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install libcephfs-devel 2023-12-06T15:24:50.337 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:02:22 ago on Wed 06 Dec 2023 03:22:28 PM UTC. 2023-12-06T15:24:52.015 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2023-12-06T15:24:52.015 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:24:52.015 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repo Size 2023-12-06T15:24:52.016 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:24:52.016 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2023-12-06T15:24:52.016 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs-devel x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 25 k 2023-12-06T15:24:52.016 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:24:52.016 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2023-12-06T15:24:52.016 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:24:52.016 INFO:teuthology.orchestra.run.smithi123.stdout:Install 1 Package 2023-12-06T15:24:52.016 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:24:52.016 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 25 k 2023-12-06T15:24:52.017 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 107 k 2023-12-06T15:24:52.017 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2023-12-06T15:24:52.236 INFO:teuthology.orchestra.run.smithi123.stdout:libcephfs-devel-16.2.14-335.gd03fca4f.el8.x86_6 116 kB/s | 25 kB 00:00 2023-12-06T15:24:52.237 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2023-12-06T15:24:52.237 INFO:teuthology.orchestra.run.smithi123.stdout:Total 115 kB/s | 25 kB 00:00 2023-12-06T15:24:52.238 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2023-12-06T15:24:52.241 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2023-12-06T15:24:52.241 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2023-12-06T15:24:52.243 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2023-12-06T15:24:52.246 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2023-12-06T15:24:52.301 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2023-12-06T15:24:52.462 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephfs-devel-2:16.2.14-335.gd03fca4f.el8.x86_64 1/1 2023-12-06T15:24:52.729 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephfs-devel-2:16.2.14-335.gd03fca4f.el8.x86_64 1/1 2023-12-06T15:24:53.367 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephfs-devel-2:16.2.14-335.gd03fca4f.el8.x86_64 1/1 2023-12-06T15:24:53.367 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:24:53.367 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2023-12-06T15:24:53.368 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs-devel-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T15:24:53.368 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:24:53.368 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2023-12-06T15:24:53.486 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install librados2 2023-12-06T15:24:54.334 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:02:26 ago on Wed 06 Dec 2023 03:22:28 PM UTC. 2023-12-06T15:24:55.786 INFO:teuthology.orchestra.run.smithi123.stdout:Package librados2-2:16.2.14-335.gd03fca4f.el8.x86_64 is already installed. 2023-12-06T15:24:56.010 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2023-12-06T15:24:56.011 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2023-12-06T15:24:56.012 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2023-12-06T15:24:56.114 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install librbd1 2023-12-06T15:24:56.964 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:02:28 ago on Wed 06 Dec 2023 03:22:28 PM UTC. 2023-12-06T15:24:58.436 INFO:teuthology.orchestra.run.smithi123.stdout:Package librbd1-2:16.2.14-335.gd03fca4f.el8.x86_64 is already installed. 2023-12-06T15:24:58.665 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2023-12-06T15:24:58.666 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2023-12-06T15:24:58.666 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2023-12-06T15:24:58.830 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install python3-rados 2023-12-06T15:24:59.690 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:02:31 ago on Wed 06 Dec 2023 03:22:28 PM UTC. 2023-12-06T15:25:01.146 INFO:teuthology.orchestra.run.smithi123.stdout:Package python3-rados-2:16.2.14-335.gd03fca4f.el8.x86_64 is already installed. 2023-12-06T15:25:01.370 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2023-12-06T15:25:01.372 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2023-12-06T15:25:01.372 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2023-12-06T15:25:01.464 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install python3-rgw 2023-12-06T15:25:02.316 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:02:34 ago on Wed 06 Dec 2023 03:22:28 PM UTC. 2023-12-06T15:25:03.755 INFO:teuthology.orchestra.run.smithi123.stdout:Package python3-rgw-2:16.2.14-335.gd03fca4f.el8.x86_64 is already installed. 2023-12-06T15:25:03.980 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2023-12-06T15:25:03.981 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2023-12-06T15:25:03.981 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2023-12-06T15:25:04.078 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install python3-cephfs 2023-12-06T15:25:04.937 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:02:36 ago on Wed 06 Dec 2023 03:22:28 PM UTC. 2023-12-06T15:25:06.392 INFO:teuthology.orchestra.run.smithi123.stdout:Package python3-cephfs-2:16.2.14-335.gd03fca4f.el8.x86_64 is already installed. 2023-12-06T15:25:06.625 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2023-12-06T15:25:06.626 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2023-12-06T15:25:06.626 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2023-12-06T15:25:06.726 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install python3-rbd 2023-12-06T15:25:07.587 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:02:39 ago on Wed 06 Dec 2023 03:22:28 PM UTC. 2023-12-06T15:25:09.028 INFO:teuthology.orchestra.run.smithi123.stdout:Package python3-rbd-2:16.2.14-335.gd03fca4f.el8.x86_64 is already installed. 2023-12-06T15:25:09.251 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2023-12-06T15:25:09.252 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2023-12-06T15:25:09.252 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2023-12-06T15:25:09.350 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install rbd-fuse 2023-12-06T15:25:10.195 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:02:42 ago on Wed 06 Dec 2023 03:22:28 PM UTC. 2023-12-06T15:25:11.861 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2023-12-06T15:25:11.862 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:25:11.862 INFO:teuthology.orchestra.run.smithi123.stdout: Package Architecture Version Repository Size 2023-12-06T15:25:11.862 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:25:11.862 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2023-12-06T15:25:11.862 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 88 k 2023-12-06T15:25:11.863 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:11.863 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2023-12-06T15:25:11.863 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:25:11.863 INFO:teuthology.orchestra.run.smithi123.stdout:Install 1 Package 2023-12-06T15:25:11.863 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:11.864 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 88 k 2023-12-06T15:25:11.864 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 240 k 2023-12-06T15:25:11.864 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2023-12-06T15:25:12.134 INFO:teuthology.orchestra.run.smithi123.stdout:rbd-fuse-16.2.14-335.gd03fca4f.el8.x86_64.rpm 326 kB/s | 88 kB 00:00 2023-12-06T15:25:12.134 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2023-12-06T15:25:12.134 INFO:teuthology.orchestra.run.smithi123.stdout:Total 325 kB/s | 88 kB 00:00 2023-12-06T15:25:12.135 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2023-12-06T15:25:12.144 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2023-12-06T15:25:12.144 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2023-12-06T15:25:12.193 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2023-12-06T15:25:12.195 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2023-12-06T15:25:12.299 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2023-12-06T15:25:12.509 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-fuse-2:16.2.14-335.gd03fca4f.el8.x86_64 1/1 2023-12-06T15:25:12.800 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: rbd-fuse-2:16.2.14-335.gd03fca4f.el8.x86_64 1/1 2023-12-06T15:25:13.490 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-fuse-2:16.2.14-335.gd03fca4f.el8.x86_64 1/1 2023-12-06T15:25:13.490 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:13.490 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2023-12-06T15:25:13.490 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T15:25:13.490 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:13.490 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2023-12-06T15:25:13.676 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install rbd-mirror 2023-12-06T15:25:14.538 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:02:46 ago on Wed 06 Dec 2023 03:22:28 PM UTC. 2023-12-06T15:25:16.229 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2023-12-06T15:25:16.229 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:25:16.229 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repo Size 2023-12-06T15:25:16.229 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:25:16.229 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2023-12-06T15:25:16.229 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 3.7 M 2023-12-06T15:25:16.230 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:16.230 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2023-12-06T15:25:16.230 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:25:16.230 INFO:teuthology.orchestra.run.smithi123.stdout:Install 1 Package 2023-12-06T15:25:16.230 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:16.230 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 3.7 M 2023-12-06T15:25:16.230 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 15 M 2023-12-06T15:25:16.230 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2023-12-06T15:25:16.702 INFO:teuthology.orchestra.run.smithi123.stdout:rbd-mirror-16.2.14-335.gd03fca4f.el8.x86_64.rpm 7.7 MB/s | 3.7 MB 00:00 2023-12-06T15:25:16.703 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2023-12-06T15:25:16.703 INFO:teuthology.orchestra.run.smithi123.stdout:Total 7.7 MB/s | 3.7 MB 00:00 2023-12-06T15:25:16.704 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2023-12-06T15:25:16.715 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2023-12-06T15:25:16.715 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2023-12-06T15:25:16.777 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2023-12-06T15:25:16.780 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2023-12-06T15:25:17.222 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2023-12-06T15:25:17.417 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-mirror-2:16.2.14-335.gd03fca4f.el8.x86_64 1/1 2023-12-06T15:25:17.846 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: rbd-mirror-2:16.2.14-335.gd03fca4f.el8.x86_64 1/1 2023-12-06T15:25:18.555 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-mirror-2:16.2.14-335.gd03fca4f.el8.x86_64 1/1 2023-12-06T15:25:18.555 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:18.555 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2023-12-06T15:25:18.555 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T15:25:18.556 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:18.556 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2023-12-06T15:25:18.754 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install rbd-nbd 2023-12-06T15:25:19.620 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:02:51 ago on Wed 06 Dec 2023 03:22:28 PM UTC. 2023-12-06T15:25:21.294 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2023-12-06T15:25:21.295 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:25:21.295 INFO:teuthology.orchestra.run.smithi123.stdout: Package Architecture Version Repository Size 2023-12-06T15:25:21.295 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:25:21.295 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2023-12-06T15:25:21.295 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 175 k 2023-12-06T15:25:21.296 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:21.296 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2023-12-06T15:25:21.296 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-12-06T15:25:21.296 INFO:teuthology.orchestra.run.smithi123.stdout:Install 1 Package 2023-12-06T15:25:21.296 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:21.296 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 175 k 2023-12-06T15:25:21.296 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 523 k 2023-12-06T15:25:21.296 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2023-12-06T15:25:21.480 INFO:teuthology.orchestra.run.smithi123.stdout:rbd-nbd-16.2.14-335.gd03fca4f.el8.x86_64.rpm 947 kB/s | 175 kB 00:00 2023-12-06T15:25:21.481 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2023-12-06T15:25:21.481 INFO:teuthology.orchestra.run.smithi123.stdout:Total 941 kB/s | 175 kB 00:00 2023-12-06T15:25:21.481 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2023-12-06T15:25:21.492 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2023-12-06T15:25:21.492 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2023-12-06T15:25:21.542 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2023-12-06T15:25:21.544 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2023-12-06T15:25:21.673 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2023-12-06T15:25:21.849 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-nbd-2:16.2.14-335.gd03fca4f.el8.x86_64 1/1 2023-12-06T15:25:22.142 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: rbd-nbd-2:16.2.14-335.gd03fca4f.el8.x86_64 1/1 2023-12-06T15:25:22.824 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-nbd-2:16.2.14-335.gd03fca4f.el8.x86_64 1/1 2023-12-06T15:25:22.824 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:22.824 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2023-12-06T15:25:22.825 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T15:25:22.825 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:22.825 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2023-12-06T15:25:23.069 DEBUG:teuthology.parallel:result is None 2023-12-06T15:25:23.070 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d03fca4f35d43f61b4679936aef7bd2f01cced0b 2023-12-06T15:25:23.214 DEBUG:teuthology.orchestra.run.smithi123:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-06T15:25:23.237 INFO:teuthology.orchestra.run.smithi123.stdout:16.2.14-335.gd03fca4f.el8 2023-12-06T15:25:23.237 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-335.gd03fca4f.el8 2023-12-06T15:25:23.237 INFO:teuthology.task.install:The correct ceph version 16.2.14-335.gd03fca4f is installed. 2023-12-06T15:25:23.238 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-06T15:25:23.238 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-12-06T15:25:23.238 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-06T15:25:23.305 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-06T15:25:23.305 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-12-06T15:25:23.305 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/daemon-helper 2023-12-06T15:25:23.372 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-06T15:25:23.439 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-06T15:25:23.439 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-12-06T15:25:23.439 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-06T15:25:23.506 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-06T15:25:23.572 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-06T15:25:23.573 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-12-06T15:25:23.573 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/stdin-killer 2023-12-06T15:25:23.639 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-06T15:25:23.705 INFO:teuthology.run_tasks:Running task ceph... 2023-12-06T15:25:23.872 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-06T15:25:23.872 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 777 /var/log/ceph 2023-12-06T15:25:23.898 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-06T15:25:23.898 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-06T15:25:23.965 INFO:tasks.ceph:Creating extra log directories... 2023-12-06T15:25:23.965 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-06T15:25:24.040 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-06T15:25:24.040 INFO:tasks.ceph:config {'conf': {'client': {'rbd default format': 1}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(CACHE_POOL_NO_HIT_SET\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-06T15:25:24.040 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-12-06_15:04:09-rbd-wip-yuri6-testing-2023-12-05-0753-pacific-distro-default-smithi/7480284', 'branch': 'wip-yuri6-testing-2023-12-05-0753-pacific', 'description': 'rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_generic}', 'email': None, 'first_in_suite': False, 'job_id': '7480284', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2023-12-06_15:04:09-rbd-wip-yuri6-testing-2023-12-05-0753-pacific-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 30}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri6-testing-2023-12-05-0753-pacific'}, 'ceph': {'conf': {'client': {'rbd default format': 1}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(CACHE_POOL_NO_HIT_SET\\)'], 'sha1': 'd03fca4f35d43f61b4679936aef7bd2f01cced0b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd03fca4f35d43f61b4679936aef7bd2f01cced0b'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri6-testing-2023-12-05-0753-pacific', 'sha1': 'd03fca4f35d43f61b4679936aef7bd2f01cced0b'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 5062, 'sha1': 'd03fca4f35d43f61b4679936aef7bd2f01cced0b', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rbd', 'suite_branch': 'wip-yuri6-testing-2023-12-05-0753-pacific', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_d03fca4f35d43f61b4679936aef7bd2f01cced0b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'd03fca4f35d43f61b4679936aef7bd2f01cced0b', 'targets': {'smithi123.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHeQVPISHcmI5TLqh0nLOypLb2joRoA+bSMQnZFLfT13MuvqO9kaVTuEeunWyXow20WNJyApaaPv4vHQNfEtb9M='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'exec': {'client.0': ['sudo ceph osd pool create cache 4', 'sudo ceph osd tier add rbd cache', 'sudo ceph osd tier cache-mode cache writeback', 'sudo ceph osd tier set-overlay rbd cache', 'sudo ceph osd pool set cache hit_set_type bloom', 'sudo ceph osd pool set cache hit_set_count 8', 'sudo ceph osd pool set cache hit_set_period 60', 'sudo ceph osd pool set cache target_max_objects 250']}}, {'workunit': {'clients': {'client.0': ['rbd/cli_generic.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'f2de108beb0a6dde7f3e6c96039071828a1f6269', 'timestamp': '2023-12-06_15:04:09', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-12-06T15:25:24.041 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-06T15:25:24.090 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m0777 -- /var/run/ceph 2023-12-06T15:25:24.157 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-12-06T15:25:24.157 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/scratch_devs of=/dev/stdout 2023-12-06T15:25:24.215 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-06T15:25:24.216 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_1 2023-12-06T15:25:24.273 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-06T15:25:24.273 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-06T15:25:24.273 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 392491 Links: 1 2023-12-06T15:25:24.273 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-06T15:25:24.274 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2023-12-06T15:25:24.274 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2023-12-06 15:25:17.600105748 +0000 2023-12-06T15:25:24.274 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2023-12-06 15:21:23.177942554 +0000 2023-12-06T15:25:24.274 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2023-12-06 15:21:23.177942554 +0000 2023-12-06T15:25:24.274 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2023-12-06T15:25:24.274 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-06T15:25:24.339 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2023-12-06T15:25:24.339 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2023-12-06T15:25:24.339 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000224748 s, 2.3 MB/s 2023-12-06T15:25:24.340 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-06T15:25:24.399 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_2 2023-12-06T15:25:24.457 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-06T15:25:24.458 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-06T15:25:24.458 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 395604 Links: 1 2023-12-06T15:25:24.458 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-06T15:25:24.458 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2023-12-06T15:25:24.458 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2023-12-06 15:25:17.600105748 +0000 2023-12-06T15:25:24.458 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2023-12-06 15:21:23.677930876 +0000 2023-12-06T15:25:24.458 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2023-12-06 15:21:23.677930876 +0000 2023-12-06T15:25:24.458 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2023-12-06T15:25:24.458 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-06T15:25:24.522 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2023-12-06T15:25:24.522 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2023-12-06T15:25:24.523 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000191776 s, 2.7 MB/s 2023-12-06T15:25:24.524 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-06T15:25:24.582 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_3 2023-12-06T15:25:24.640 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-06T15:25:24.640 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-06T15:25:24.640 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 398677 Links: 1 2023-12-06T15:25:24.640 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-06T15:25:24.641 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2023-12-06T15:25:24.641 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2023-12-06 15:25:17.600105748 +0000 2023-12-06T15:25:24.641 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2023-12-06 15:21:24.181919103 +0000 2023-12-06T15:25:24.641 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2023-12-06 15:21:24.181919103 +0000 2023-12-06T15:25:24.641 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2023-12-06T15:25:24.641 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-06T15:25:24.705 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2023-12-06T15:25:24.705 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2023-12-06T15:25:24.706 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000184845 s, 2.8 MB/s 2023-12-06T15:25:24.706 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-06T15:25:24.766 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_4 2023-12-06T15:25:24.823 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-06T15:25:24.823 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-06T15:25:24.824 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 393640 Links: 1 2023-12-06T15:25:24.824 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-06T15:25:24.824 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2023-12-06T15:25:24.824 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2023-12-06 15:25:17.600105748 +0000 2023-12-06T15:25:24.824 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2023-12-06 15:21:24.693907144 +0000 2023-12-06T15:25:24.824 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2023-12-06 15:21:24.693907144 +0000 2023-12-06T15:25:24.824 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2023-12-06T15:25:24.824 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-06T15:25:24.889 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2023-12-06T15:25:24.889 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2023-12-06T15:25:24.889 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000224121 s, 2.3 MB/s 2023-12-06T15:25:24.890 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-06T15:25:24.949 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-12-06T15:25:24.949 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi123.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2023-12-06T15:25:24.949 INFO:tasks.ceph:Generating config... 2023-12-06T15:25:24.952 INFO:tasks.ceph:[client] rbd default format = 1 2023-12-06T15:25:24.952 INFO:tasks.ceph:[global] mon client directed command retry = 5 2023-12-06T15:25:24.952 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2023-12-06T15:25:24.952 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-06T15:25:24.952 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-06T15:25:24.952 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-06T15:25:24.953 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-06T15:25:24.953 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-06T15:25:24.953 INFO:tasks.ceph:[osd] bdev async discard = True 2023-12-06T15:25:24.953 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-12-06T15:25:24.953 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2023-12-06T15:25:24.953 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-06T15:25:24.953 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-06T15:25:24.953 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-12-06T15:25:24.953 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-12-06T15:25:24.953 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-06T15:25:24.953 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-06T15:25:24.953 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-12-06T15:25:24.953 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-06T15:25:24.953 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-06T15:25:24.954 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-06T15:25:24.954 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-06T15:25:24.954 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-06T15:25:24.954 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-12-06T15:25:24.954 INFO:tasks.ceph:Setting up mon.a... 2023-12-06T15:25:24.954 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-06T15:25:25.104 INFO:teuthology.orchestra.run.smithi123.stdout:creating /etc/ceph/ceph.keyring 2023-12-06T15:25:25.107 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-06T15:25:25.147 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-06T15:25:25.213 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.123')] 2023-12-06T15:25:25.213 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.123', 'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd default format': 1}, 'mon.a': {}} 2023-12-06T15:25:25.214 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-12-06T15:25:25.214 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-06T15:25:25.271 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.123 --print /home/ubuntu/cephtest/ceph.monmap 2023-12-06T15:25:25.349 INFO:teuthology.orchestra.run.smithi123.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-06T15:25:25.350 INFO:teuthology.orchestra.run.smithi123.stdout:monmaptool: generated fsid d9839fb7-f14a-4da0-b485-65c61122611f 2023-12-06T15:25:25.350 INFO:teuthology.orchestra.run.smithi123.stdout:epoch 0 2023-12-06T15:25:25.350 INFO:teuthology.orchestra.run.smithi123.stdout:fsid d9839fb7-f14a-4da0-b485-65c61122611f 2023-12-06T15:25:25.350 INFO:teuthology.orchestra.run.smithi123.stdout:last_changed 2023-12-06T15:25:25.350949+0000 2023-12-06T15:25:25.350 INFO:teuthology.orchestra.run.smithi123.stdout:created 2023-12-06T15:25:25.350949+0000 2023-12-06T15:25:25.350 INFO:teuthology.orchestra.run.smithi123.stdout:min_mon_release 0 (unknown) 2023-12-06T15:25:25.350 INFO:teuthology.orchestra.run.smithi123.stdout:election_strategy: 1 2023-12-06T15:25:25.350 INFO:teuthology.orchestra.run.smithi123.stdout:0: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.a 2023-12-06T15:25:25.350 INFO:teuthology.orchestra.run.smithi123.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2023-12-06T15:25:25.351 DEBUG:teuthology.orchestra.run.smithi123:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-06T15:25:25.409 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d9839fb7-f14a-4da0-b485-65c61122611f... 2023-12-06T15:25:25.410 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-06T15:25:25.493 INFO:teuthology.orchestra.run.smithi123.stdout:[global] 2023-12-06T15:25:25.494 INFO:teuthology.orchestra.run.smithi123.stdout: chdir = "" 2023-12-06T15:25:25.494 INFO:teuthology.orchestra.run.smithi123.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-06T15:25:25.494 INFO:teuthology.orchestra.run.smithi123.stdout: auth supported = cephx 2023-12-06T15:25:25.494 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:25.494 INFO:teuthology.orchestra.run.smithi123.stdout: filestore xattr use omap = true 2023-12-06T15:25:25.494 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:25.494 INFO:teuthology.orchestra.run.smithi123.stdout: mon clock drift allowed = 1.000 2023-12-06T15:25:25.494 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:25.494 INFO:teuthology.orchestra.run.smithi123.stdout: osd crush chooseleaf type = 0 2023-12-06T15:25:25.494 INFO:teuthology.orchestra.run.smithi123.stdout: auth debug = true 2023-12-06T15:25:25.494 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:25.494 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on old message = true 2023-12-06T15:25:25.495 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on bug = true 2023-12-06T15:25:25.495 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:25.495 INFO:teuthology.orchestra.run.smithi123.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-06T15:25:25.495 INFO:teuthology.orchestra.run.smithi123.stdout: mon pg warn max object skew = 0 2023-12-06T15:25:25.495 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:25.495 INFO:teuthology.orchestra.run.smithi123.stdout: # disable pg_autoscaler by default for new pools 2023-12-06T15:25:25.495 INFO:teuthology.orchestra.run.smithi123.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-06T15:25:25.495 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:25.495 INFO:teuthology.orchestra.run.smithi123.stdout: osd pool default size = 2 2023-12-06T15:25:25.495 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:25.495 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd allow primary affinity = true 2023-12-06T15:25:25.495 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd allow pg remap = true 2023-12-06T15:25:25.495 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on legacy crush tunables = false 2023-12-06T15:25:25.495 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on crush straw calc version zero = false 2023-12-06T15:25:25.495 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on no sortbitwise = false 2023-12-06T15:25:25.496 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on osd down out interval zero = false 2023-12-06T15:25:25.496 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on too few osds = false 2023-12-06T15:25:25.496 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-06T15:25:25.496 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-06T15:25:25.496 INFO:teuthology.orchestra.run.smithi123.stdout: mon_allow_pool_size_one = true 2023-12-06T15:25:25.496 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:25.496 INFO:teuthology.orchestra.run.smithi123.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-12-06T15:25:25.496 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:25.496 INFO:teuthology.orchestra.run.smithi123.stdout: osd default data pool replay window = 5 2023-12-06T15:25:25.496 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:25.496 INFO:teuthology.orchestra.run.smithi123.stdout: mon allow pool delete = true 2023-12-06T15:25:25.496 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:25.496 INFO:teuthology.orchestra.run.smithi123.stdout: mon cluster log file level = debug 2023-12-06T15:25:25.496 INFO:teuthology.orchestra.run.smithi123.stdout: debug asserts on shutdown = true 2023-12-06T15:25:25.496 INFO:teuthology.orchestra.run.smithi123.stdout: mon health detail to clog = false 2023-12-06T15:25:25.497 INFO:teuthology.orchestra.run.smithi123.stdout: mon host = 172.21.15.123 2023-12-06T15:25:25.497 INFO:teuthology.orchestra.run.smithi123.stdout: mon client directed command retry = 5 2023-12-06T15:25:25.497 INFO:teuthology.orchestra.run.smithi123.stdout: ms inject socket failures = 5000 2023-12-06T15:25:25.497 INFO:teuthology.orchestra.run.smithi123.stdout: fsid = d9839fb7-f14a-4da0-b485-65c61122611f 2023-12-06T15:25:25.497 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:25.497 INFO:teuthology.orchestra.run.smithi123.stdout:[osd] 2023-12-06T15:25:25.497 INFO:teuthology.orchestra.run.smithi123.stdout: osd journal size = 100 2023-12-06T15:25:25.497 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:25.497 INFO:teuthology.orchestra.run.smithi123.stdout: osd scrub load threshold = 5.0 2023-12-06T15:25:25.497 INFO:teuthology.orchestra.run.smithi123.stdout: osd scrub max interval = 600 2023-12-06T15:25:25.497 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:25.497 INFO:teuthology.orchestra.run.smithi123.stdout: osd recover clone overlap = true 2023-12-06T15:25:25.497 INFO:teuthology.orchestra.run.smithi123.stdout: osd recovery max chunk = 1048576 2023-12-06T15:25:25.497 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:25.497 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug shutdown = true 2023-12-06T15:25:25.497 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug op order = true 2023-12-06T15:25:25.498 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug verify stray on activate = true 2023-12-06T15:25:25.498 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:25.498 INFO:teuthology.orchestra.run.smithi123.stdout: osd open classes on start = true 2023-12-06T15:25:25.498 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug pg log writeout = true 2023-12-06T15:25:25.498 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:25.498 INFO:teuthology.orchestra.run.smithi123.stdout: osd deep scrub update digest min age = 30 2023-12-06T15:25:25.498 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:25.498 INFO:teuthology.orchestra.run.smithi123.stdout: osd map max advance = 10 2023-12-06T15:25:25.498 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:25.498 INFO:teuthology.orchestra.run.smithi123.stdout: journal zero on create = true 2023-12-06T15:25:25.498 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:25.498 INFO:teuthology.orchestra.run.smithi123.stdout: filestore ondisk finisher threads = 3 2023-12-06T15:25:25.499 INFO:teuthology.orchestra.run.smithi123.stdout: filestore apply finisher threads = 3 2023-12-06T15:25:25.499 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:25.499 INFO:teuthology.orchestra.run.smithi123.stdout: bdev debug aio = true 2023-12-06T15:25:25.499 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug misdirected ops = true 2023-12-06T15:25:25.499 INFO:teuthology.orchestra.run.smithi123.stdout: bdev async discard = True 2023-12-06T15:25:25.499 INFO:teuthology.orchestra.run.smithi123.stdout: bdev enable discard = True 2023-12-06T15:25:25.499 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore allocator = stupid 2023-12-06T15:25:25.499 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore block size = 96636764160 2023-12-06T15:25:25.499 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore fsck on mount = True 2023-12-06T15:25:25.499 INFO:teuthology.orchestra.run.smithi123.stdout: debug bluefs = 1/20 2023-12-06T15:25:25.499 INFO:teuthology.orchestra.run.smithi123.stdout: debug bluestore = 1/20 2023-12-06T15:25:25.499 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2023-12-06T15:25:25.499 INFO:teuthology.orchestra.run.smithi123.stdout: debug osd = 20 2023-12-06T15:25:25.499 INFO:teuthology.orchestra.run.smithi123.stdout: debug rocksdb = 4/10 2023-12-06T15:25:25.499 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd backfillfull_ratio = 0.85 2023-12-06T15:25:25.500 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd full ratio = 0.9 2023-12-06T15:25:25.500 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd nearfull ratio = 0.8 2023-12-06T15:25:25.500 INFO:teuthology.orchestra.run.smithi123.stdout: osd failsafe full ratio = 0.95 2023-12-06T15:25:25.500 INFO:teuthology.orchestra.run.smithi123.stdout: osd objectstore = bluestore 2023-12-06T15:25:25.500 INFO:teuthology.orchestra.run.smithi123.stdout: osd shutdown pgref assert = True 2023-12-06T15:25:25.500 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:25.500 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr] 2023-12-06T15:25:25.500 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2023-12-06T15:25:25.500 INFO:teuthology.orchestra.run.smithi123.stdout: debug mgr = 20 2023-12-06T15:25:25.500 INFO:teuthology.orchestra.run.smithi123.stdout: debug mon = 20 2023-12-06T15:25:25.500 INFO:teuthology.orchestra.run.smithi123.stdout: debug auth = 20 2023-12-06T15:25:25.500 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min pgs per osd = 4 2023-12-06T15:25:25.500 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min bytes per osd = 10 2023-12-06T15:25:25.500 INFO:teuthology.orchestra.run.smithi123.stdout: mgr/telemetry/nag = false 2023-12-06T15:25:25.500 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:25.500 INFO:teuthology.orchestra.run.smithi123.stdout:[mon] 2023-12-06T15:25:25.501 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2023-12-06T15:25:25.501 INFO:teuthology.orchestra.run.smithi123.stdout: debug mon = 20 2023-12-06T15:25:25.501 INFO:teuthology.orchestra.run.smithi123.stdout: debug paxos = 20 2023-12-06T15:25:25.501 INFO:teuthology.orchestra.run.smithi123.stdout: debug auth = 20 2023-12-06T15:25:25.501 INFO:teuthology.orchestra.run.smithi123.stdout: mon data avail warn = 5 2023-12-06T15:25:25.501 INFO:teuthology.orchestra.run.smithi123.stdout: mon mgr mkfs grace = 240 2023-12-06T15:25:25.501 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min pgs per osd = 4 2023-12-06T15:25:25.501 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd reporter subtree level = osd 2023-12-06T15:25:25.501 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd prime pg temp = true 2023-12-06T15:25:25.501 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min bytes per osd = 10 2023-12-06T15:25:25.501 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:25.501 INFO:teuthology.orchestra.run.smithi123.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-06T15:25:25.501 INFO:teuthology.orchestra.run.smithi123.stdout: auth mon ticket ttl = 660 # 11m 2023-12-06T15:25:25.501 INFO:teuthology.orchestra.run.smithi123.stdout: auth service ticket ttl = 240 # 4m 2023-12-06T15:25:25.501 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:25.501 INFO:teuthology.orchestra.run.smithi123.stdout: # don't complain about insecure global_id in the test suite 2023-12-06T15:25:25.502 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-06T15:25:25.502 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-06T15:25:25.502 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:25.502 INFO:teuthology.orchestra.run.smithi123.stdout:[client] 2023-12-06T15:25:25.502 INFO:teuthology.orchestra.run.smithi123.stdout: rgw cache enabled = true 2023-12-06T15:25:25.502 INFO:teuthology.orchestra.run.smithi123.stdout: rgw enable ops log = true 2023-12-06T15:25:25.502 INFO:teuthology.orchestra.run.smithi123.stdout: rgw enable usage log = true 2023-12-06T15:25:25.502 INFO:teuthology.orchestra.run.smithi123.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-06T15:25:25.502 INFO:teuthology.orchestra.run.smithi123.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-06T15:25:25.502 INFO:teuthology.orchestra.run.smithi123.stdout: rbd default format = 1 2023-12-06T15:25:25.502 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.a] 2023-12-06T15:25:25.504 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-06T15:25:25.504 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-06T15:25:25.596 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-06T15:25:25.596 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-12-06T15:25:25.596 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-06T15:25:25.613 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-12-06T15:25:25.613 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-06T15:25:25.670 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi123.front.sepia.ceph.com 2023-12-06T15:25:25.671 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-12-06T15:25:25.671 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-06T15:25:25.671 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-06T15:25:25.746 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-12-06T15:25:25.747 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-06T15:25:25.804 INFO:tasks.ceph:Setting up mon nodes... 2023-12-06T15:25:25.804 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-06T15:25:25.804 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-06T15:25:25.892 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-06T15:25:25.894 INFO:tasks.ceph:Setting up mds nodes... 2023-12-06T15:25:25.894 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-06T15:25:25.895 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-06T15:25:25.933 INFO:teuthology.orchestra.run.smithi123.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-06T15:25:25.945 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-06T15:25:25.945 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi123.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2023-12-06T15:25:25.945 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-06T15:25:26.012 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-12-06T15:25:26.012 INFO:tasks.ceph:role: osd.0 2023-12-06T15:25:26.012 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi123.front.sepia.ceph.com 2023-12-06T15:25:26.013 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-06T15:25:26.086 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-06T15:25:26.086 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-06T15:25:26.086 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-06T15:25:26.087 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-06T15:25:26.087 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-06T15:25:26.087 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2023-12-06T15:25:26.087 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-06T15:25:26.087 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-06T15:25:26.087 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-06T15:25:26.087 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-06T15:25:26.517 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2023-12-06T15:25:26.519 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2023-12-06T15:25:26.519 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-06T15:25:26.678 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-06T15:25:26.712 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-06T15:25:26.779 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-12-06T15:25:26.780 INFO:tasks.ceph:role: osd.1 2023-12-06T15:25:26.780 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi123.front.sepia.ceph.com 2023-12-06T15:25:26.780 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-06T15:25:26.853 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-06T15:25:26.853 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-06T15:25:26.853 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-06T15:25:26.853 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-06T15:25:26.853 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-06T15:25:26.853 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2023-12-06T15:25:26.853 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-06T15:25:26.854 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-06T15:25:26.854 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-06T15:25:26.854 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-06T15:25:27.279 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2023-12-06T15:25:27.281 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2023-12-06T15:25:27.281 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-06T15:25:27.395 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-06T15:25:27.425 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-06T15:25:27.492 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-12-06T15:25:27.492 INFO:tasks.ceph:role: osd.2 2023-12-06T15:25:27.492 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi123.front.sepia.ceph.com 2023-12-06T15:25:27.492 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-06T15:25:27.567 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-06T15:25:27.567 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-06T15:25:27.567 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-06T15:25:27.567 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-06T15:25:27.567 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-06T15:25:27.567 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2023-12-06T15:25:27.567 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-06T15:25:27.567 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-06T15:25:27.567 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-06T15:25:27.568 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-06T15:25:28.023 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2023-12-06T15:25:28.024 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2023-12-06T15:25:28.025 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-06T15:25:28.175 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-06T15:25:28.250 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-06T15:25:28.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-12-06T15:25:28.350+0000 7f93de093380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-06T15:25:28.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-12-06T15:25:28.355+0000 7f93de093380 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-06T15:25:28.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-12-06T15:25:28.355+0000 7f93de093380 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-06T15:25:28.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-12-06T15:25:28.355+0000 7f93de093380 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-06T15:25:28.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-12-06T15:25:28.355+0000 7f93de093380 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-06T15:25:28.358 INFO:teuthology.orchestra.run.smithi123.stderr:2023-12-06T15:25:28.357+0000 7f93de093380 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-06T15:25:31.203 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-06T15:25:31.233 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-06T15:25:31.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-12-06T15:25:31.319+0000 7ff53c7c0380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-06T15:25:31.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-12-06T15:25:31.319+0000 7ff53c7c0380 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-06T15:25:31.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-12-06T15:25:31.319+0000 7ff53c7c0380 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-06T15:25:31.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-12-06T15:25:31.319+0000 7ff53c7c0380 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-06T15:25:31.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-12-06T15:25:31.319+0000 7ff53c7c0380 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-06T15:25:31.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-12-06T15:25:31.320+0000 7ff53c7c0380 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-06T15:25:34.158 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-06T15:25:34.191 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-06T15:25:34.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-12-06T15:25:34.279+0000 7f0d2830c380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-06T15:25:34.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-12-06T15:25:34.279+0000 7f0d2830c380 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-06T15:25:34.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-12-06T15:25:34.279+0000 7f0d2830c380 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-06T15:25:34.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-12-06T15:25:34.279+0000 7f0d2830c380 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-06T15:25:34.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-12-06T15:25:34.279+0000 7f0d2830c380 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-06T15:25:34.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-12-06T15:25:34.280+0000 7f0d2830c380 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-06T15:25:37.116 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-06T15:25:37.148 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-06T15:25:37.149 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-12-06T15:25:37.149 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-06T15:25:37.221 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-12-06T15:25:37.221 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-06T15:25:37.294 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-12-06T15:25:37.294 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-06T15:25:37.365 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-12-06T15:25:37.365 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-06T15:25:37.435 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-12-06T15:25:37.435 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-06T15:25:37.494 INFO:tasks.ceph:Adding keys to all mons... 2023-12-06T15:25:37.494 DEBUG:teuthology.orchestra.run.smithi123:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-06T15:25:37.560 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr.x] 2023-12-06T15:25:37.561 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBlknBlGblHNRAA7wGIcNnce8K3aWgCN1lplA== 2023-12-06T15:25:37.561 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.0] 2023-12-06T15:25:37.561 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBoknBlYwUCFRAAQ40ntAmwB6UMfZftnuUdnw== 2023-12-06T15:25:37.561 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.1] 2023-12-06T15:25:37.561 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBrknBlxxsUExAA0yvkCSAqlWBtk1rV+ICFcA== 2023-12-06T15:25:37.561 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.2] 2023-12-06T15:25:37.561 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBuknBlvWSyEBAALb6CkJKZAeWy/Cr1dizt7w== 2023-12-06T15:25:37.561 INFO:teuthology.orchestra.run.smithi123.stdout:[client.0] 2023-12-06T15:25:37.561 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBlknBlMWO3NxAAyZlUjNXRpOfCEYvsDVmeig== 2023-12-06T15:25:37.562 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-06T15:25:37.653 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-06T15:25:37.701 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-06T15:25:37.749 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-06T15:25:37.797 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-06T15:25:37.849 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-06T15:25:37.849 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-06T15:25:37.876 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-06T15:25:37.969 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-06T15:25:37.995 DEBUG:teuthology.orchestra.run.smithi123:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-06T15:25:38.053 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-06T15:25:38.053 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-06T15:25:38.053 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-06T15:25:38.096 INFO:tasks.ceph.mon.a:Started 2023-12-06T15:25:38.096 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-06T15:25:38.096 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-06T15:25:38.096 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-06T15:25:38.098 INFO:tasks.ceph.mgr.x:Started 2023-12-06T15:25:38.098 INFO:tasks.ceph:Setting crush tunables to default 2023-12-06T15:25:38.098 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd crush tunables default 2023-12-06T15:25:38.294 INFO:teuthology.orchestra.run.smithi123.stderr:adjusted tunables profile to default 2023-12-06T15:25:38.305 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-06T15:25:38.305 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-12-06T15:25:38.305 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-06T15:25:38.331 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-12-06T15:25:38.331 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-06T15:25:38.397 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-12-06T15:25:38.397 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-06T15:25:38.464 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new 8aca3223-ca02-4768-8194-522c80e4cab0 0 2023-12-06T15:25:38.513 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-12-06T15:25:38.511+0000 7f8e785ef680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-06T15:25:38.583 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-12-06T15:25:38.583+0000 7f8e785ef680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-06T15:25:38.707 INFO:teuthology.orchestra.run.smithi123.stdout:0 2023-12-06T15:25:38.719 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new 00bd97ad-a075-4a29-8402-47a59cafeaf0 1 2023-12-06T15:25:38.964 INFO:teuthology.orchestra.run.smithi123.stdout:1 2023-12-06T15:25:38.977 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new 022162d6-8d34-40d4-8386-8c2eaa3880d4 2 2023-12-06T15:25:39.028 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-12-06T15:25:39.028+0000 7f8e785ef680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-06T15:25:39.179 INFO:teuthology.orchestra.run.smithi123.stdout:2 2023-12-06T15:25:39.191 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-06T15:25:39.191 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-06T15:25:39.193 INFO:tasks.ceph.osd.0:Started 2023-12-06T15:25:39.193 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-06T15:25:39.194 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-06T15:25:39.196 INFO:tasks.ceph.osd.1:Started 2023-12-06T15:25:39.196 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-06T15:25:39.196 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-06T15:25:39.198 INFO:tasks.ceph.osd.2:Started 2023-12-06T15:25:39.198 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-06T15:25:39.413 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:39.414 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":5,"fsid":"d9839fb7-f14a-4da0-b485-65c61122611f","created":"2023-12-06T15:25:38.200058+0000","modified":"2023-12-06T15:25:39.179248+0000","last_up_change":"0.000000","last_in_change":"2023-12-06T15:25:39.179248+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"8aca3223-ca02-4768-8194-522c80e4cab0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00bd97ad-a075-4a29-8402-47a59cafeaf0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"022162d6-8d34-40d4-8386-8c2eaa3880d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-06T15:25:39.425 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-06T15:25:39.426 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-06T15:25:39.727 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-06T15:25:39.793 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:25:39.793+0000 7efceb93d380 -1 Falling back to public interface 2023-12-06T15:25:39.798 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-12-06T15:25:39.798+0000 7f8e785ef680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-06T15:25:39.802 INFO:tasks.ceph.osd.2.smithi123.stderr:2023-12-06T15:25:39.803+0000 7ffb8ca30380 -1 Falling back to public interface 2023-12-06T15:25:39.819 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:25:39.819+0000 7f29e1253380 -1 Falling back to public interface 2023-12-06T15:25:39.873 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-12-06T15:25:39.872+0000 7f8e785ef680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-06T15:25:39.930 INFO:teuthology.misc.health.smithi123.stdout: 2023-12-06T15:25:39.930 INFO:teuthology.misc.health.smithi123.stdout:{"epoch":5,"fsid":"d9839fb7-f14a-4da0-b485-65c61122611f","created":"2023-12-06T15:25:38.200058+0000","modified":"2023-12-06T15:25:39.179248+0000","last_up_change":"0.000000","last_in_change":"2023-12-06T15:25:39.179248+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"8aca3223-ca02-4768-8194-522c80e4cab0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00bd97ad-a075-4a29-8402-47a59cafeaf0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"022162d6-8d34-40d4-8386-8c2eaa3880d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-06T15:25:39.942 DEBUG:teuthology.misc:0 of 3 OSDs are up 2023-12-06T15:25:40.062 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-12-06T15:25:40.062+0000 7f8e785ef680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-06T15:25:40.499 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-12-06T15:25:40.499+0000 7f8e785ef680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-06T15:25:40.600 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-12-06T15:25:40.601+0000 7f8e785ef680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-06T15:25:40.755 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-12-06T15:25:40.756+0000 7f8e785ef680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-06T15:25:40.831 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-12-06T15:25:40.831+0000 7f8e785ef680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-06T15:25:40.901 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-12-06T15:25:40.901+0000 7f8e785ef680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-06T15:25:41.159 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-12-06T15:25:41.159+0000 7f8e785ef680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-06T15:25:41.360 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-12-06T15:25:41.360+0000 7f8e785ef680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-06T15:25:42.027 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-12-06T15:25:42.028+0000 7f8e785ef680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-06T15:25:42.098 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-12-06T15:25:42.096+0000 7f8e785ef680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-06T15:25:42.173 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-12-06T15:25:42.173+0000 7f8e785ef680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-06T15:25:42.325 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-12-06T15:25:42.325+0000 7f8e785ef680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-06T15:25:42.395 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-12-06T15:25:42.396+0000 7f8e785ef680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-06T15:25:42.514 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-12-06T15:25:42.515+0000 7f8e785ef680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-06T15:25:42.677 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-12-06T15:25:42.678+0000 7f8e785ef680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-06T15:25:43.005 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-12-06T15:25:43.005+0000 7f8e785ef680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-06T15:25:43.079 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-12-06T15:25:43.079+0000 7f8e785ef680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-06T15:25:43.254 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:25:43.254+0000 7efceb93d380 -1 osd.0 0 log_to_monitors {default=true} 2023-12-06T15:25:43.324 INFO:tasks.ceph.osd.2.smithi123.stderr:2023-12-06T15:25:43.324+0000 7ffb8ca30380 -1 osd.2 0 log_to_monitors {default=true} 2023-12-06T15:25:43.340 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:25:43.341+0000 7f29e1253380 -1 osd.1 0 log_to_monitors {default=true} 2023-12-06T15:25:44.098 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-12-06T15:25:44.098+0000 7f8e2db08700 -1 mgr.server handle_report got status from non-daemon mon.a 2023-12-06T15:25:45.192 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:25:45.193+0000 7efce22de700 -1 osd.0 0 waiting for initial osdmap 2023-12-06T15:25:45.193 INFO:tasks.ceph.osd.2.smithi123.stderr:2023-12-06T15:25:45.193+0000 7ffb833d1700 -1 osd.2 0 waiting for initial osdmap 2023-12-06T15:25:45.193 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:25:45.193+0000 7f29d7bf4700 -1 osd.1 0 waiting for initial osdmap 2023-12-06T15:25:45.196 INFO:tasks.ceph.osd.2.smithi123.stderr:2023-12-06T15:25:45.196+0000 7ffb7fb4d700 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-06T15:25:45.196 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:25:45.197+0000 7f29d4370700 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-06T15:25:45.197 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:25:45.198+0000 7efcdea5a700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-06T15:25:46.244 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-06T15:25:46.540 INFO:teuthology.misc.health.smithi123.stdout: 2023-12-06T15:25:46.541 INFO:teuthology.misc.health.smithi123.stdout:{"epoch":8,"fsid":"d9839fb7-f14a-4da0-b485-65c61122611f","created":"2023-12-06T15:25:38.200058+0000","modified":"2023-12-06T15:25:46.189008+0000","last_up_change":"2023-12-06T15:25:46.189008+0000","last_in_change":"2023-12-06T15:25:39.179248+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"8aca3223-ca02-4768-8194-522c80e4cab0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":114439},{"type":"v1","addr":"172.21.15.123:6801","nonce":114439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":114439},{"type":"v1","addr":"172.21.15.123:6803","nonce":114439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":114439},{"type":"v1","addr":"172.21.15.123:6807","nonce":114439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":114439},{"type":"v1","addr":"172.21.15.123:6805","nonce":114439}]},"public_addr":"172.21.15.123:6801/114439","cluster_addr":"172.21.15.123:6803/114439","heartbeat_back_addr":"172.21.15.123:6807/114439","heartbeat_front_addr":"172.21.15.123:6805/114439","state":["exists","up"]},{"osd":1,"uuid":"00bd97ad-a075-4a29-8402-47a59cafeaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":114455},{"type":"v1","addr":"172.21.15.123:6817","nonce":114455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":114455},{"type":"v1","addr":"172.21.15.123:6819","nonce":114455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":114455},{"type":"v1","addr":"172.21.15.123:6823","nonce":114455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":114455},{"type":"v1","addr":"172.21.15.123:6821","nonce":114455}]},"public_addr":"172.21.15.123:6817/114455","cluster_addr":"172.21.15.123:6819/114455","heartbeat_back_addr":"172.21.15.123:6823/114455","heartbeat_front_addr":"172.21.15.123:6821/114455","state":["exists","up"]},{"osd":2,"uuid":"022162d6-8d34-40d4-8386-8c2eaa3880d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":114440},{"type":"v1","addr":"172.21.15.123:6809","nonce":114440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":114440},{"type":"v1","addr":"172.21.15.123:6811","nonce":114440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":114440},{"type":"v1","addr":"172.21.15.123:6815","nonce":114440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":114440},{"type":"v1","addr":"172.21.15.123:6813","nonce":114440}]},"public_addr":"172.21.15.123:6809/114440","cluster_addr":"172.21.15.123:6811/114440","heartbeat_back_addr":"172.21.15.123:6815/114440","heartbeat_front_addr":"172.21.15.123:6813/114440","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-06T15:25:46.553 DEBUG:teuthology.misc:3 of 3 OSDs are up 2023-12-06T15:25:46.553 INFO:tasks.ceph:Creating RBD pool 2023-12-06T15:25:46.553 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd pool create rbd 8 2023-12-06T15:25:47.202 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'rbd' created 2023-12-06T15:25:47.213 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-12-06T15:25:48.206 INFO:teuthology.orchestra.run.smithi123.stderr:enabled application 'rbd' on pool 'rbd' 2023-12-06T15:25:48.219 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-06T15:25:48.219 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-06T15:25:48.220 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-06T15:25:48.220 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-06T15:25:48.220 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-06T15:25:48.557 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:48.570 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":4,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":114031},{"type":"v1","addr":"172.21.15.123:6825","nonce":114031}]},"active_addr":"172.21.15.123:6825/114031","active_change":"2023-12-06T15:25:43.092707+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":3381661866}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":3737169063}]}]} 2023-12-06T15:25:48.572 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-06T15:25:48.572 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-06T15:25:48.572 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-06T15:25:48.857 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:48.857 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":10,"fsid":"d9839fb7-f14a-4da0-b485-65c61122611f","created":"2023-12-06T15:25:38.200058+0000","modified":"2023-12-06T15:25:48.195946+0000","last_up_change":"2023-12-06T15:25:46.189008+0000","last_in_change":"2023-12-06T15:25:39.179248+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-06T15:25:46.228677+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-06T15:25:46.870005+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"8aca3223-ca02-4768-8194-522c80e4cab0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":114439},{"type":"v1","addr":"172.21.15.123:6801","nonce":114439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":114439},{"type":"v1","addr":"172.21.15.123:6803","nonce":114439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":114439},{"type":"v1","addr":"172.21.15.123:6807","nonce":114439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":114439},{"type":"v1","addr":"172.21.15.123:6805","nonce":114439}]},"public_addr":"172.21.15.123:6801/114439","cluster_addr":"172.21.15.123:6803/114439","heartbeat_back_addr":"172.21.15.123:6807/114439","heartbeat_front_addr":"172.21.15.123:6805/114439","state":["exists","up"]},{"osd":1,"uuid":"00bd97ad-a075-4a29-8402-47a59cafeaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":114455},{"type":"v1","addr":"172.21.15.123:6817","nonce":114455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":114455},{"type":"v1","addr":"172.21.15.123:6819","nonce":114455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":114455},{"type":"v1","addr":"172.21.15.123:6823","nonce":114455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":114455},{"type":"v1","addr":"172.21.15.123:6821","nonce":114455}]},"public_addr":"172.21.15.123:6817/114455","cluster_addr":"172.21.15.123:6819/114455","heartbeat_back_addr":"172.21.15.123:6823/114455","heartbeat_front_addr":"172.21.15.123:6821/114455","state":["exists","up"]},{"osd":2,"uuid":"022162d6-8d34-40d4-8386-8c2eaa3880d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":114440},{"type":"v1","addr":"172.21.15.123:6809","nonce":114440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":114440},{"type":"v1","addr":"172.21.15.123:6811","nonce":114440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":114440},{"type":"v1","addr":"172.21.15.123:6815","nonce":114440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":114440},{"type":"v1","addr":"172.21.15.123:6813","nonce":114440}]},"public_addr":"172.21.15.123:6809/114440","cluster_addr":"172.21.15.123:6811/114440","heartbeat_back_addr":"172.21.15.123:6815/114440","heartbeat_front_addr":"172.21.15.123:6813/114440","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T15:25:44.297358+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T15:25:44.369755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T15:25:44.324521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-06T15:25:48.878 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-06T15:25:48.879 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-06T15:25:49.167 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:49.167 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":10,"fsid":"d9839fb7-f14a-4da0-b485-65c61122611f","created":"2023-12-06T15:25:38.200058+0000","modified":"2023-12-06T15:25:48.195946+0000","last_up_change":"2023-12-06T15:25:46.189008+0000","last_in_change":"2023-12-06T15:25:39.179248+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-06T15:25:46.228677+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-06T15:25:46.870005+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"8aca3223-ca02-4768-8194-522c80e4cab0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":114439},{"type":"v1","addr":"172.21.15.123:6801","nonce":114439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":114439},{"type":"v1","addr":"172.21.15.123:6803","nonce":114439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":114439},{"type":"v1","addr":"172.21.15.123:6807","nonce":114439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":114439},{"type":"v1","addr":"172.21.15.123:6805","nonce":114439}]},"public_addr":"172.21.15.123:6801/114439","cluster_addr":"172.21.15.123:6803/114439","heartbeat_back_addr":"172.21.15.123:6807/114439","heartbeat_front_addr":"172.21.15.123:6805/114439","state":["exists","up"]},{"osd":1,"uuid":"00bd97ad-a075-4a29-8402-47a59cafeaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":114455},{"type":"v1","addr":"172.21.15.123:6817","nonce":114455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":114455},{"type":"v1","addr":"172.21.15.123:6819","nonce":114455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":114455},{"type":"v1","addr":"172.21.15.123:6823","nonce":114455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":114455},{"type":"v1","addr":"172.21.15.123:6821","nonce":114455}]},"public_addr":"172.21.15.123:6817/114455","cluster_addr":"172.21.15.123:6819/114455","heartbeat_back_addr":"172.21.15.123:6823/114455","heartbeat_front_addr":"172.21.15.123:6821/114455","state":["exists","up"]},{"osd":2,"uuid":"022162d6-8d34-40d4-8386-8c2eaa3880d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":114440},{"type":"v1","addr":"172.21.15.123:6809","nonce":114440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":114440},{"type":"v1","addr":"172.21.15.123:6811","nonce":114440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":114440},{"type":"v1","addr":"172.21.15.123:6815","nonce":114440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":114440},{"type":"v1","addr":"172.21.15.123:6813","nonce":114440}]},"public_addr":"172.21.15.123:6809/114440","cluster_addr":"172.21.15.123:6811/114440","heartbeat_back_addr":"172.21.15.123:6815/114440","heartbeat_front_addr":"172.21.15.123:6813/114440","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T15:25:44.297358+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T15:25:44.369755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T15:25:44.324521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-06T15:25:49.180 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-06T15:25:49.333 INFO:teuthology.orchestra.run.smithi123.stdout:34359738370 2023-12-06T15:25:49.333 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-06T15:25:49.480 INFO:teuthology.orchestra.run.smithi123.stdout:34359738371 2023-12-06T15:25:49.480 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-06T15:25:49.628 INFO:teuthology.orchestra.run.smithi123.stdout:34359738370 2023-12-06T15:25:49.628 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-06T15:25:49.914 INFO:teuthology.orchestra.run.smithi123.stdout:34359738369 2023-12-06T15:25:49.927 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738370 got 34359738369 for osd.0 2023-12-06T15:25:50.928 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-06T15:25:51.229 INFO:teuthology.orchestra.run.smithi123.stdout:34359738370 2023-12-06T15:25:51.243 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738370 got 34359738370 for osd.0 2023-12-06T15:25:51.243 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-06T15:25:51.529 INFO:teuthology.orchestra.run.smithi123.stdout:34359738371 2023-12-06T15:25:51.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738371 for osd.1 2023-12-06T15:25:51.542 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-06T15:25:51.827 INFO:teuthology.orchestra.run.smithi123.stdout:34359738370 2023-12-06T15:25:51.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738370 got 34359738370 for osd.2 2023-12-06T15:25:51.840 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-06T15:25:51.840 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T15:25:52.118 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:52.120 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2023-12-06T15:25:52.131 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2023-12-06T15:25:51.096849+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":891556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":891264,"kb_avail":282223964,"statfs":{"total":289910292480,"available":288997339136,"internally_reserved":0,"allocated":274432,"data_stored":71480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":912654336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T15:25:48.207193+0000","last_change":"2023-12-06T15:25:48.207193+0000","last_active":"2023-12-06T15:25:48.207193+0000","last_peered":"2023-12-06T15:25:48.207193+0000","last_clean":"2023-12-06T15:25:48.207193+0000","last_became_active":"2023-12-06T15:25:48.206888+0000","last_became_peered":"2023-12-06T15:25:48.206888+0000","last_unstale":"2023-12-06T15:25:48.207193+0000","last_undegraded":"2023-12-06T15:25:48.207193+0000","last_fullsized":"2023-12-06T15:25:48.207193+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T15:25:48.207319+0000","last_change":"2023-12-06T15:25:48.207319+0000","last_active":"2023-12-06T15:25:48.207319+0000","last_peered":"2023-12-06T15:25:48.207319+0000","last_clean":"2023-12-06T15:25:48.207319+0000","last_became_active":"2023-12-06T15:25:48.206986+0000","last_became_peered":"2023-12-06T15:25:48.206986+0000","last_unstale":"2023-12-06T15:25:48.207319+0000","last_undegraded":"2023-12-06T15:25:48.207319+0000","last_fullsized":"2023-12-06T15:25:48.207319+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T15:25:48.207203+0000","last_change":"2023-12-06T15:25:48.207203+0000","last_active":"2023-12-06T15:25:48.207203+0000","last_peered":"2023-12-06T15:25:48.207203+0000","last_clean":"2023-12-06T15:25:48.207203+0000","last_became_active":"2023-12-06T15:25:48.206906+0000","last_became_peered":"2023-12-06T15:25:48.206906+0000","last_unstale":"2023-12-06T15:25:48.207203+0000","last_undegraded":"2023-12-06T15:25:48.207203+0000","last_fullsized":"2023-12-06T15:25:48.207203+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T15:25:48.204584+0000","last_change":"2023-12-06T15:25:48.204584+0000","last_active":"2023-12-06T15:25:48.204584+0000","last_peered":"2023-12-06T15:25:48.204584+0000","last_clean":"2023-12-06T15:25:48.204584+0000","last_became_active":"2023-12-06T15:25:48.204290+0000","last_became_peered":"2023-12-06T15:25:48.204290+0000","last_unstale":"2023-12-06T15:25:48.204584+0000","last_undegraded":"2023-12-06T15:25:48.204584+0000","last_fullsized":"2023-12-06T15:25:48.204584+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T15:25:48.207167+0000","last_change":"2023-12-06T15:25:48.207167+0000","last_active":"2023-12-06T15:25:48.207167+0000","last_peered":"2023-12-06T15:25:48.207167+0000","last_clean":"2023-12-06T15:25:48.207167+0000","last_became_active":"2023-12-06T15:25:48.206870+0000","last_became_peered":"2023-12-06T15:25:48.206870+0000","last_unstale":"2023-12-06T15:25:48.207167+0000","last_undegraded":"2023-12-06T15:25:48.207167+0000","last_fullsized":"2023-12-06T15:25:48.207167+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T15:25:48.206040+0000","last_change":"2023-12-06T15:25:48.206040+0000","last_active":"2023-12-06T15:25:48.206040+0000","last_peered":"2023-12-06T15:25:48.206040+0000","last_clean":"2023-12-06T15:25:48.206040+0000","last_became_active":"2023-12-06T15:25:48.205750+0000","last_became_peered":"2023-12-06T15:25:48.205750+0000","last_unstale":"2023-12-06T15:25:48.206040+0000","last_undegraded":"2023-12-06T15:25:48.206040+0000","last_fullsized":"2023-12-06T15:25:48.206040+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T15:25:48.206298+0000","last_change":"2023-12-06T15:25:48.206298+0000","last_active":"2023-12-06T15:25:48.206298+0000","last_peered":"2023-12-06T15:25:48.206298+0000","last_clean":"2023-12-06T15:25:48.206298+0000","last_became_active":"2023-12-06T15:25:48.205967+0000","last_became_peered":"2023-12-06T15:25:48.205967+0000","last_unstale":"2023-12-06T15:25:48.206298+0000","last_undegraded":"2023-12-06T15:25:48.206298+0000","last_fullsized":"2023-12-06T15:25:48.206298+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T15:25:48.206517+0000","last_change":"2023-12-06T15:25:48.204459+0000","last_active":"2023-12-06T15:25:48.206517+0000","last_peered":"2023-12-06T15:25:48.206517+0000","last_clean":"2023-12-06T15:25:48.206517+0000","last_became_active":"2023-12-06T15:25:48.204147+0000","last_became_peered":"2023-12-06T15:25:48.204147+0000","last_unstale":"2023-12-06T15:25:48.206517+0000","last_undegraded":"2023-12-06T15:25:48.206517+0000","last_fullsized":"2023-12-06T15:25:48.206517+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T15:25:48.205141+0000","last_change":"2023-12-06T15:25:48.205141+0000","last_active":"2023-12-06T15:25:48.205141+0000","last_peered":"2023-12-06T15:25:48.205141+0000","last_clean":"2023-12-06T15:25:48.205141+0000","last_became_active":"2023-12-06T15:25:48.204913+0000","last_became_peered":"2023-12-06T15:25:48.204913+0000","last_unstale":"2023-12-06T15:25:48.205141+0000","last_undegraded":"2023-12-06T15:25:48.205141+0000","last_fullsized":"2023-12-06T15:25:48.205141+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738370,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297184,"kb_used_data":88,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074656,"statfs":{"total":96636764160,"available":96332447744,"internally_reserved":0,"allocated":90112,"data_stored":22896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]}]},{"osd":0,"up_from":8,"seq":34359738370,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297188,"kb_used_data":92,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074652,"statfs":{"total":96636764160,"available":96332443648,"internally_reserved":0,"allocated":94208,"data_stored":25688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297184,"kb_used_data":88,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074656,"statfs":{"total":96636764160,"available":96332447744,"internally_reserved":0,"allocated":90112,"data_stored":22896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T15:25:52.132 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T15:25:52.414 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:52.416 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2023-12-06T15:25:52.427 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2023-12-06T15:25:51.096849+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":891556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":891264,"kb_avail":282223964,"statfs":{"total":289910292480,"available":288997339136,"internally_reserved":0,"allocated":274432,"data_stored":71480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":912654336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T15:25:48.207193+0000","last_change":"2023-12-06T15:25:48.207193+0000","last_active":"2023-12-06T15:25:48.207193+0000","last_peered":"2023-12-06T15:25:48.207193+0000","last_clean":"2023-12-06T15:25:48.207193+0000","last_became_active":"2023-12-06T15:25:48.206888+0000","last_became_peered":"2023-12-06T15:25:48.206888+0000","last_unstale":"2023-12-06T15:25:48.207193+0000","last_undegraded":"2023-12-06T15:25:48.207193+0000","last_fullsized":"2023-12-06T15:25:48.207193+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T15:25:48.207319+0000","last_change":"2023-12-06T15:25:48.207319+0000","last_active":"2023-12-06T15:25:48.207319+0000","last_peered":"2023-12-06T15:25:48.207319+0000","last_clean":"2023-12-06T15:25:48.207319+0000","last_became_active":"2023-12-06T15:25:48.206986+0000","last_became_peered":"2023-12-06T15:25:48.206986+0000","last_unstale":"2023-12-06T15:25:48.207319+0000","last_undegraded":"2023-12-06T15:25:48.207319+0000","last_fullsized":"2023-12-06T15:25:48.207319+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T15:25:48.207203+0000","last_change":"2023-12-06T15:25:48.207203+0000","last_active":"2023-12-06T15:25:48.207203+0000","last_peered":"2023-12-06T15:25:48.207203+0000","last_clean":"2023-12-06T15:25:48.207203+0000","last_became_active":"2023-12-06T15:25:48.206906+0000","last_became_peered":"2023-12-06T15:25:48.206906+0000","last_unstale":"2023-12-06T15:25:48.207203+0000","last_undegraded":"2023-12-06T15:25:48.207203+0000","last_fullsized":"2023-12-06T15:25:48.207203+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T15:25:48.204584+0000","last_change":"2023-12-06T15:25:48.204584+0000","last_active":"2023-12-06T15:25:48.204584+0000","last_peered":"2023-12-06T15:25:48.204584+0000","last_clean":"2023-12-06T15:25:48.204584+0000","last_became_active":"2023-12-06T15:25:48.204290+0000","last_became_peered":"2023-12-06T15:25:48.204290+0000","last_unstale":"2023-12-06T15:25:48.204584+0000","last_undegraded":"2023-12-06T15:25:48.204584+0000","last_fullsized":"2023-12-06T15:25:48.204584+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T15:25:48.207167+0000","last_change":"2023-12-06T15:25:48.207167+0000","last_active":"2023-12-06T15:25:48.207167+0000","last_peered":"2023-12-06T15:25:48.207167+0000","last_clean":"2023-12-06T15:25:48.207167+0000","last_became_active":"2023-12-06T15:25:48.206870+0000","last_became_peered":"2023-12-06T15:25:48.206870+0000","last_unstale":"2023-12-06T15:25:48.207167+0000","last_undegraded":"2023-12-06T15:25:48.207167+0000","last_fullsized":"2023-12-06T15:25:48.207167+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T15:25:48.206040+0000","last_change":"2023-12-06T15:25:48.206040+0000","last_active":"2023-12-06T15:25:48.206040+0000","last_peered":"2023-12-06T15:25:48.206040+0000","last_clean":"2023-12-06T15:25:48.206040+0000","last_became_active":"2023-12-06T15:25:48.205750+0000","last_became_peered":"2023-12-06T15:25:48.205750+0000","last_unstale":"2023-12-06T15:25:48.206040+0000","last_undegraded":"2023-12-06T15:25:48.206040+0000","last_fullsized":"2023-12-06T15:25:48.206040+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T15:25:48.206298+0000","last_change":"2023-12-06T15:25:48.206298+0000","last_active":"2023-12-06T15:25:48.206298+0000","last_peered":"2023-12-06T15:25:48.206298+0000","last_clean":"2023-12-06T15:25:48.206298+0000","last_became_active":"2023-12-06T15:25:48.205967+0000","last_became_peered":"2023-12-06T15:25:48.205967+0000","last_unstale":"2023-12-06T15:25:48.206298+0000","last_undegraded":"2023-12-06T15:25:48.206298+0000","last_fullsized":"2023-12-06T15:25:48.206298+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T15:25:48.206517+0000","last_change":"2023-12-06T15:25:48.204459+0000","last_active":"2023-12-06T15:25:48.206517+0000","last_peered":"2023-12-06T15:25:48.206517+0000","last_clean":"2023-12-06T15:25:48.206517+0000","last_became_active":"2023-12-06T15:25:48.204147+0000","last_became_peered":"2023-12-06T15:25:48.204147+0000","last_unstale":"2023-12-06T15:25:48.206517+0000","last_undegraded":"2023-12-06T15:25:48.206517+0000","last_fullsized":"2023-12-06T15:25:48.206517+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T15:25:48.205141+0000","last_change":"2023-12-06T15:25:48.205141+0000","last_active":"2023-12-06T15:25:48.205141+0000","last_peered":"2023-12-06T15:25:48.205141+0000","last_clean":"2023-12-06T15:25:48.205141+0000","last_became_active":"2023-12-06T15:25:48.204913+0000","last_became_peered":"2023-12-06T15:25:48.204913+0000","last_unstale":"2023-12-06T15:25:48.205141+0000","last_undegraded":"2023-12-06T15:25:48.205141+0000","last_fullsized":"2023-12-06T15:25:48.205141+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738370,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297184,"kb_used_data":88,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074656,"statfs":{"total":96636764160,"available":96332447744,"internally_reserved":0,"allocated":90112,"data_stored":22896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]}]},{"osd":0,"up_from":8,"seq":34359738370,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297188,"kb_used_data":92,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074652,"statfs":{"total":96636764160,"available":96332443648,"internally_reserved":0,"allocated":94208,"data_stored":25688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297184,"kb_used_data":88,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074656,"statfs":{"total":96636764160,"available":96332447744,"internally_reserved":0,"allocated":90112,"data_stored":22896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T15:25:52.428 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-06T15:25:52.428 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-06T15:25:52.428 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-06T15:25:52.428 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-06T15:25:52.746 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T15:25:52.759 INFO:teuthology.orchestra.run.smithi123.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-06T15:25:52.759 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-06T15:25:52.760 INFO:teuthology.run_tasks:Running task exec... 2023-12-06T15:25:52.769 INFO:teuthology.task.exec:Executing custom commands... 2023-12-06T15:25:52.769 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi123.front.sepia.ceph.com 2023-12-06T15:25:52.769 DEBUG:teuthology.orchestra.run.smithi123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool create cache 4' 2023-12-06T15:25:53.215 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cache' created 2023-12-06T15:25:53.227 DEBUG:teuthology.orchestra.run.smithi123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier add rbd cache' 2023-12-06T15:25:54.216 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cache' is now (or already was) a tier of 'rbd' 2023-12-06T15:25:54.231 DEBUG:teuthology.orchestra.run.smithi123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier cache-mode cache writeback' 2023-12-06T15:25:55.227 INFO:teuthology.orchestra.run.smithi123.stderr:set cache-mode for pool 'cache' to writeback 2023-12-06T15:25:55.240 DEBUG:teuthology.orchestra.run.smithi123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier set-overlay rbd cache' 2023-12-06T15:25:56.229 INFO:teuthology.orchestra.run.smithi123.stderr:overlay for 'rbd' is now (or already was) 'cache' 2023-12-06T15:25:56.243 DEBUG:teuthology.orchestra.run.smithi123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_type bloom' 2023-12-06T15:25:57.232 INFO:teuthology.orchestra.run.smithi123.stderr:set pool 3 hit_set_type to bloom 2023-12-06T15:25:57.244 DEBUG:teuthology.orchestra.run.smithi123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_count 8' 2023-12-06T15:25:58.236 INFO:teuthology.orchestra.run.smithi123.stderr:set pool 3 hit_set_count to 8 2023-12-06T15:25:58.248 DEBUG:teuthology.orchestra.run.smithi123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_period 60' 2023-12-06T15:25:59.239 INFO:teuthology.orchestra.run.smithi123.stderr:set pool 3 hit_set_period to 60 2023-12-06T15:25:59.252 DEBUG:teuthology.orchestra.run.smithi123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache target_max_objects 250' 2023-12-06T15:26:00.241 INFO:teuthology.orchestra.run.smithi123.stderr:set pool 3 target_max_objects to 250 2023-12-06T15:26:00.254 INFO:teuthology.run_tasks:Running task workunit... 2023-12-06T15:26:00.294 INFO:tasks.workunit:Pulling workunits from ref d03fca4f35d43f61b4679936aef7bd2f01cced0b 2023-12-06T15:26:00.294 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-06T15:26:00.294 DEBUG:teuthology.orchestra.run.smithi123:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-06T15:26:00.314 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-06T15:26:00.315 INFO:teuthology.orchestra.run.smithi123.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-12-06T15:26:00.315 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-12-06T15:26:00.374 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-12-06T15:26:00.374 DEBUG:teuthology.orchestra.run.smithi123:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-12-06T15:26:00.432 INFO:tasks.workunit:timeout=3h 2023-12-06T15:26:00.432 INFO:tasks.workunit:cleanup=True 2023-12-06T15:26:00.433 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d03fca4f35d43f61b4679936aef7bd2f01cced0b 2023-12-06T15:26:00.491 INFO:tasks.workunit.client.0.smithi123.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-06T15:26:43.377 INFO:tasks.workunit.client.0.smithi123.stderr:Note: switching to 'd03fca4f35d43f61b4679936aef7bd2f01cced0b'. 2023-12-06T15:26:43.377 INFO:tasks.workunit.client.0.smithi123.stderr: 2023-12-06T15:26:43.377 INFO:tasks.workunit.client.0.smithi123.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-06T15:26:43.377 INFO:tasks.workunit.client.0.smithi123.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-06T15:26:43.377 INFO:tasks.workunit.client.0.smithi123.stderr:state without impacting any branches by switching back to a branch. 2023-12-06T15:26:43.377 INFO:tasks.workunit.client.0.smithi123.stderr: 2023-12-06T15:26:43.377 INFO:tasks.workunit.client.0.smithi123.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-06T15:26:43.377 INFO:tasks.workunit.client.0.smithi123.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-06T15:26:43.378 INFO:tasks.workunit.client.0.smithi123.stderr: 2023-12-06T15:26:43.378 INFO:tasks.workunit.client.0.smithi123.stderr: git switch -c 2023-12-06T15:26:43.378 INFO:tasks.workunit.client.0.smithi123.stderr: 2023-12-06T15:26:43.378 INFO:tasks.workunit.client.0.smithi123.stderr:Or undo this operation with: 2023-12-06T15:26:43.378 INFO:tasks.workunit.client.0.smithi123.stderr: 2023-12-06T15:26:43.378 INFO:tasks.workunit.client.0.smithi123.stderr: git switch - 2023-12-06T15:26:43.378 INFO:tasks.workunit.client.0.smithi123.stderr: 2023-12-06T15:26:43.378 INFO:tasks.workunit.client.0.smithi123.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-06T15:26:43.378 INFO:tasks.workunit.client.0.smithi123.stderr: 2023-12-06T15:26:43.378 INFO:tasks.workunit.client.0.smithi123.stderr:HEAD is now at d03fca4f35d Merge branch 'wip-ifed-fix-63606' of https://github.com/ifed01/ceph into wip-yuri6-testing-2023-12-05-0753-pacific 2023-12-06T15:26:43.382 DEBUG:teuthology.orchestra.run.smithi123:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-06T15:26:43.444 INFO:tasks.workunit.client.0.smithi123.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-06T15:26:43.446 INFO:tasks.workunit.client.0.smithi123.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-06T15:26:43.446 INFO:tasks.workunit.client.0.smithi123.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-06T15:26:44.001 INFO:tasks.workunit.client.0.smithi123.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-06T15:26:44.065 INFO:tasks.workunit.client.0.smithi123.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-06T15:26:44.102 INFO:tasks.workunit.client.0.smithi123.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-06T15:26:44.104 INFO:tasks.workunit.client.0.smithi123.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-06T15:26:44.104 INFO:tasks.workunit.client.0.smithi123.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-06T15:26:44.140 INFO:tasks.workunit.client.0.smithi123.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-06T15:26:44.142 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-12-06T15:26:44.142 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-06T15:26:44.202 INFO:tasks.workunit:Running workunits matching rbd/cli_generic.sh on client.0... 2023-12-06T15:26:44.204 INFO:tasks.workunit:Running workunit rbd/cli_generic.sh... 2023-12-06T15:26:44.204 DEBUG:teuthology.orchestra.run.smithi123:workunit test rbd/cli_generic.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d03fca4f35d43f61b4679936aef7bd2f01cced0b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh 2023-12-06T15:26:44.266 INFO:tasks.workunit.client.0.smithi123.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh 2023-12-06T15:26:44.266 INFO:tasks.workunit.client.0.smithi123.stderr:+ . /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/../../standalone/ceph-helpers.sh 2023-12-06T15:26:44.266 INFO:tasks.workunit.client.0.smithi123.stderr:++ TIMEOUT=300 2023-12-06T15:26:44.266 INFO:tasks.workunit.client.0.smithi123.stderr:++ WAIT_FOR_CLEAN_TIMEOUT=90 2023-12-06T15:26:44.266 INFO:tasks.workunit.client.0.smithi123.stderr:++ MAX_TIMEOUT=15 2023-12-06T15:26:44.266 INFO:tasks.workunit.client.0.smithi123.stderr:++ PG_NUM=4 2023-12-06T15:26:44.266 INFO:tasks.workunit.client.0.smithi123.stderr:++ TMPDIR=/tmp 2023-12-06T15:26:44.266 INFO:tasks.workunit.client.0.smithi123.stderr:++ CEPH_BUILD_VIRTUALENV=/tmp 2023-12-06T15:26:44.266 INFO:tasks.workunit.client.0.smithi123.stderr:++ TESTDIR=/home/ubuntu/cephtest 2023-12-06T15:26:44.267 INFO:tasks.workunit.client.0.smithi123.stderr:++ type xmlstarlet 2023-12-06T15:26:44.267 INFO:tasks.workunit.client.0.smithi123.stderr:++ XMLSTARLET=xmlstarlet 2023-12-06T15:26:44.267 INFO:tasks.workunit.client.0.smithi123.stderr:+++ uname 2023-12-06T15:26:44.268 INFO:tasks.workunit.client.0.smithi123.stderr:++ '[' Linux = FreeBSD ']' 2023-12-06T15:26:44.268 INFO:tasks.workunit.client.0.smithi123.stderr:++ SED=sed 2023-12-06T15:26:44.268 INFO:tasks.workunit.client.0.smithi123.stderr:++ AWK=awk 2023-12-06T15:26:44.269 INFO:tasks.workunit.client.0.smithi123.stderr:+++ stty -a 2023-12-06T15:26:44.269 INFO:tasks.workunit.client.0.smithi123.stderr:+++ head -1 2023-12-06T15:26:44.269 INFO:tasks.workunit.client.0.smithi123.stderr:+++ sed -e 's/.*columns \([0-9]*\).*/\1/' 2023-12-06T15:26:44.269 INFO:tasks.workunit.client.0.smithi123.stderr:stty: 'standard input': Inappropriate ioctl for device 2023-12-06T15:26:44.269 INFO:tasks.workunit.client.0.smithi123.stderr:++ termwidth= 2023-12-06T15:26:44.269 INFO:tasks.workunit.client.0.smithi123.stderr:++ '[' -n '' -a '' '!=' 0 ']' 2023-12-06T15:26:44.269 INFO:tasks.workunit.client.0.smithi123.stderr:++ DIFFCOLOPTS='-y ' 2023-12-06T15:26:44.269 INFO:tasks.workunit.client.0.smithi123.stderr:++ KERNCORE=kernel.core_pattern 2023-12-06T15:26:44.269 INFO:tasks.workunit.client.0.smithi123.stderr:++ EXTRA_OPTS= 2023-12-06T15:26:44.273 INFO:tasks.workunit.client.0.smithi123.stderr:++ test '' = TESTS 2023-12-06T15:26:44.273 INFO:tasks.workunit.client.0.smithi123.stderr:+ export RBD_FORCE_ALLOW_V1=1 2023-12-06T15:26:44.274 INFO:tasks.workunit.client.0.smithi123.stderr:+ RBD_FORCE_ALLOW_V1=1 2023-12-06T15:26:44.274 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:26:44.274 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:26:44.274 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -v '^0$' 2023-12-06T15:26:44.318 INFO:tasks.workunit.client.0.smithi123.stderr:+ IMGS='testimg1 testimg2 testimg3 testimg4 testimg5 testimg6 testimg-diff1 testimg-diff2 testimg-diff3 foo foo2 bar bar2 test1 test2 test3 test4 clone2' 2023-12-06T15:26:44.318 INFO:tasks.workunit.client.0.smithi123.stderr:+ tiered=0 2023-12-06T15:26:44.318 INFO:tasks.workunit.client.0.smithi123.stderr:+ ceph osd dump 2023-12-06T15:26:44.318 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^pool' 2023-12-06T15:26:44.318 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep ''\''rbd'\''' 2023-12-06T15:26:44.318 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep tier 2023-12-06T15:26:44.695 INFO:tasks.workunit.client.0.smithi123.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 15 lfor 15/15/15 flags hashpspool tiers 3 read_tier 3 write_tier 3 stripe_width 0 application rbd 2023-12-06T15:26:44.695 INFO:tasks.workunit.client.0.smithi123.stderr:+ tiered=1 2023-12-06T15:26:44.701 INFO:tasks.workunit.client.0.smithi123.stderr:+ test_pool_image_args 2023-12-06T15:26:44.701 INFO:tasks.workunit.client.0.smithi123.stdout:testing pool and image args... 2023-12-06T15:26:44.702 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 'testing pool and image args...' 2023-12-06T15:26:44.702 INFO:tasks.workunit.client.0.smithi123.stderr:+ remove_images 2023-12-06T15:26:44.702 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:44.771 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:44.837 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:44.903 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:44.969 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:45.038 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:45.111 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:45.176 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:45.249 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:45.323 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:45.390 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:45.456 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:45.531 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:45.598 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:45.665 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:45.733 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:45.807 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:45.882 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:45.951 INFO:tasks.workunit.client.0.smithi123.stderr:+ ceph osd pool delete test test --yes-i-really-really-mean-it 2023-12-06T15:26:46.324 INFO:tasks.workunit.client.0.smithi123.stderr:pool 'test' does not exist 2023-12-06T15:26:46.333 INFO:tasks.workunit.client.0.smithi123.stderr:+ ceph osd pool create test 32 2023-12-06T15:26:47.400 INFO:tasks.workunit.client.0.smithi123.stderr:pool 'test' already exists 2023-12-06T15:26:47.409 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd pool init test 2023-12-06T15:26:50.305 INFO:tasks.workunit.client.0.smithi123.stderr:+ truncate -s 1 /tmp/empty /tmp/empty@snap 2023-12-06T15:26:50.325 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:26:50.325 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:26:50.325 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 0 2023-12-06T15:26:50.361 INFO:tasks.workunit.client.0.smithi123.stdout:0 2023-12-06T15:26:50.361 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create -s 1 test1 2023-12-06T15:26:50.390 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:26:50.390+0000 7fda665a9380 -1 librbd: Forced V1 image creation. 2023-12-06T15:26:52.323 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:26:52.323 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q test1 2023-12-06T15:26:52.352 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd import --image test2 /tmp/empty 2023-12-06T15:26:52.380 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:26:52.380+0000 7fbc7c055380 -1 librbd: Forced V1 image creation. 2023-12-06T15:26:52.390 INFO:tasks.workunit.client.0.smithi123.stderr: Importing image: 100% complete...done. 2023-12-06T15:26:52.390 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: --image is deprecated, use --dest 2023-12-06T15:26:52.393 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:26:52.393 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q test2 2023-12-06T15:26:52.420 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd --dest test3 import /tmp/empty 2023-12-06T15:26:52.447 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:26:52.446+0000 7f64223a2380 -1 librbd: Forced V1 image creation. 2023-12-06T15:26:52.457 INFO:tasks.workunit.client.0.smithi123.stderr: Importing image: 100% complete...done. 2023-12-06T15:26:52.460 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:26:52.460 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q test3 2023-12-06T15:26:52.486 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd import /tmp/empty foo 2023-12-06T15:26:52.511 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:26:52.511+0000 7f9b3d23d380 -1 librbd: Forced V1 image creation. 2023-12-06T15:26:52.520 INFO:tasks.workunit.client.0.smithi123.stderr: Importing image: 100% complete...done. 2023-12-06T15:26:52.523 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:26:52.523 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q foo 2023-12-06T15:26:52.548 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd import --dest test/empty@snap /tmp/empty 2023-12-06T15:26:52.568 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2023-12-06T15:26:52.569 INFO:tasks.workunit.client.0.smithi123.stderr:+ true 2023-12-06T15:26:52.569 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd import /tmp/empty test/empty@snap 2023-12-06T15:26:52.588 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2023-12-06T15:26:52.589 INFO:tasks.workunit.client.0.smithi123.stderr:+ true 2023-12-06T15:26:52.589 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd import --image test/empty@snap /tmp/empty 2023-12-06T15:26:52.609 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2023-12-06T15:26:52.610 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: --image is deprecated, use --dest 2023-12-06T15:26:52.611 INFO:tasks.workunit.client.0.smithi123.stderr:+ true 2023-12-06T15:26:52.611 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd import /tmp/empty@snap 2023-12-06T15:26:52.628 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2023-12-06T15:26:52.630 INFO:tasks.workunit.client.0.smithi123.stderr:+ true 2023-12-06T15:26:52.630 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls test 2023-12-06T15:26:52.630 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:26:52.630 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 0 2023-12-06T15:26:52.656 INFO:tasks.workunit.client.0.smithi123.stdout:0 2023-12-06T15:26:52.656 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd import /tmp/empty test/test1 2023-12-06T15:26:52.681 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:26:52.680+0000 7f86ed457380 -1 librbd: Forced V1 image creation. 2023-12-06T15:26:54.339 INFO:tasks.workunit.client.0.smithi123.stderr: Importing image: 100% complete...done. 2023-12-06T15:26:54.342 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls test 2023-12-06T15:26:54.342 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q test1 2023-12-06T15:26:54.372 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd -p test import /tmp/empty test2 2023-12-06T15:26:54.400 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:26:54.399+0000 7fbc50c41380 -1 librbd: Forced V1 image creation. 2023-12-06T15:26:54.412 INFO:tasks.workunit.client.0.smithi123.stderr: Importing image: 100% complete...done. 2023-12-06T15:26:54.413 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2023-12-06T15:26:54.415 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls test 2023-12-06T15:26:54.415 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q test2 2023-12-06T15:26:54.442 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd --image test3 -p test import /tmp/empty 2023-12-06T15:26:54.470 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:26:54.469+0000 7f3cb388e380 -1 librbd: Forced V1 image creation. 2023-12-06T15:26:54.481 INFO:tasks.workunit.client.0.smithi123.stderr: Importing image: 100% complete...done. 2023-12-06T15:26:54.482 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: --image is deprecated, use --dest 2023-12-06T15:26:54.482 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2023-12-06T15:26:54.486 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls test 2023-12-06T15:26:54.486 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q test3 2023-12-06T15:26:54.511 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd --image test4 -p test import /tmp/empty 2023-12-06T15:26:54.538 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:26:54.538+0000 7f642e290380 -1 librbd: Forced V1 image creation. 2023-12-06T15:26:54.548 INFO:tasks.workunit.client.0.smithi123.stderr: Importing image: 100% complete...done. 2023-12-06T15:26:54.549 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: --image is deprecated, use --dest 2023-12-06T15:26:54.549 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2023-12-06T15:26:54.551 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls test 2023-12-06T15:26:54.551 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q test4 2023-12-06T15:26:54.577 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd --dest test5 -p test import /tmp/empty 2023-12-06T15:26:54.605 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:26:54.604+0000 7f43c839e380 -1 librbd: Forced V1 image creation. 2023-12-06T15:26:54.613 INFO:tasks.workunit.client.0.smithi123.stderr: Importing image: 100% complete...done. 2023-12-06T15:26:54.613 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2023-12-06T15:26:54.615 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls test 2023-12-06T15:26:54.615 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q test5 2023-12-06T15:26:54.642 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd --dest test6 --dest-pool test import /tmp/empty 2023-12-06T15:26:54.670 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:26:54.669+0000 7ff1a3e6e380 -1 librbd: Forced V1 image creation. 2023-12-06T15:26:54.681 INFO:tasks.workunit.client.0.smithi123.stderr: Importing image: 100% complete...done. 2023-12-06T15:26:54.683 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls test 2023-12-06T15:26:54.683 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q test6 2023-12-06T15:26:54.710 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd --image test7 --dest-pool test import /tmp/empty 2023-12-06T15:26:54.737 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:26:54.737+0000 7f18612be380 -1 librbd: Forced V1 image creation. 2023-12-06T15:26:54.747 INFO:tasks.workunit.client.0.smithi123.stderr: Importing image: 100% complete...done. 2023-12-06T15:26:54.748 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: --image is deprecated, use --dest 2023-12-06T15:26:54.750 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls test 2023-12-06T15:26:54.750 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q test7 2023-12-06T15:26:54.776 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd --image test/test8 import /tmp/empty 2023-12-06T15:26:54.802 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:26:54.802+0000 7f7539a2d380 -1 librbd: Forced V1 image creation. 2023-12-06T15:26:54.814 INFO:tasks.workunit.client.0.smithi123.stderr: Importing image: 100% complete...done. 2023-12-06T15:26:54.815 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: --image is deprecated, use --dest 2023-12-06T15:26:54.817 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls test 2023-12-06T15:26:54.817 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q test8 2023-12-06T15:26:54.843 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd --dest test/test9 import /tmp/empty 2023-12-06T15:26:54.869 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:26:54.868+0000 7f7fb91dc380 -1 librbd: Forced V1 image creation. 2023-12-06T15:26:54.879 INFO:tasks.workunit.client.0.smithi123.stderr: Importing image: 100% complete...done. 2023-12-06T15:26:54.881 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls test 2023-12-06T15:26:54.881 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q test9 2023-12-06T15:26:54.907 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd import --pool test /tmp/empty 2023-12-06T15:26:54.934 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:26:54.933+0000 7f1c4db0b380 -1 librbd: Forced V1 image creation. 2023-12-06T15:26:54.942 INFO:tasks.workunit.client.0.smithi123.stderr: Importing image: 100% complete...done. 2023-12-06T15:26:54.943 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2023-12-06T15:26:54.945 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls test 2023-12-06T15:26:54.945 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q empty 2023-12-06T15:26:54.971 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd copy test/test9 test10 2023-12-06T15:26:56.352 INFO:tasks.workunit.client.0.smithi123.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2023-12-06T15:26:56.356 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls test 2023-12-06T15:26:56.356 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -qv test10 2023-12-06T15:26:56.386 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:26:56.386 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q test10 2023-12-06T15:26:56.614 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd copy test/test9 test/test10 2023-12-06T15:26:56.663 INFO:tasks.workunit.client.0.smithi123.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2023-12-06T15:26:56.666 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls test 2023-12-06T15:26:56.666 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q test10 2023-12-06T15:26:56.694 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd copy --pool test test10 --dest-pool test test11 2023-12-06T15:26:56.746 INFO:tasks.workunit.client.0.smithi123.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2023-12-06T15:26:56.747 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls test 2023-12-06T15:26:56.747 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -q test11 2023-12-06T15:26:56.773 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd copy --dest-pool rbd --pool test test11 test12 2023-12-06T15:26:56.822 INFO:tasks.workunit.client.0.smithi123.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2023-12-06T15:26:56.825 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:26:56.825 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep test12 2023-12-06T15:26:56.850 INFO:tasks.workunit.client.0.smithi123.stdout:test12 2023-12-06T15:26:56.851 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls test 2023-12-06T15:26:56.851 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -qv test12 2023-12-06T15:26:56.877 INFO:tasks.workunit.client.0.smithi123.stderr:+ rm -f /tmp/empty /tmp/empty@snap 2023-12-06T15:26:56.878 INFO:tasks.workunit.client.0.smithi123.stderr:+ ceph osd pool delete test test --yes-i-really-really-mean-it 2023-12-06T15:26:57.440 INFO:tasks.workunit.client.0.smithi123.stderr:pool 'test' does not exist 2023-12-06T15:26:57.449 INFO:tasks.workunit.client.0.smithi123.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-12-06T15:26:57.449 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm foo 2023-12-06T15:26:57.502 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:26:57.505 INFO:tasks.workunit.client.0.smithi123.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-12-06T15:26:57.505 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test1 2023-12-06T15:26:57.542 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:26:57.544 INFO:tasks.workunit.client.0.smithi123.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-12-06T15:26:57.544 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test10 2023-12-06T15:26:57.614 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:26:57.616 INFO:tasks.workunit.client.0.smithi123.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-12-06T15:26:57.616 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test12 2023-12-06T15:26:57.687 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:26:57.689 INFO:tasks.workunit.client.0.smithi123.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-12-06T15:26:57.690 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test2 2023-12-06T15:26:57.724 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:26:57.726 INFO:tasks.workunit.client.0.smithi123.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-12-06T15:26:57.726 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test3 2023-12-06T15:26:57.761 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:26:57.762 INFO:tasks.workunit.client.0.smithi123.stderr:+ test_rename 2023-12-06T15:26:57.762 INFO:tasks.workunit.client.0.smithi123.stdout:testing rename... 2023-12-06T15:26:57.763 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 'testing rename...' 2023-12-06T15:26:57.763 INFO:tasks.workunit.client.0.smithi123.stderr:+ remove_images 2023-12-06T15:26:57.763 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:57.828 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:57.894 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:57.960 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:58.026 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:58.092 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:58.163 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:58.229 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:58.299 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:58.368 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:58.434 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:58.506 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:58.577 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:58.643 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:58.708 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:58.774 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:58.840 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:58.905 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:26:58.972 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 1 -s 1 foo 2023-12-06T15:26:58.994 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: image format 1 is deprecated 2023-12-06T15:26:58.999 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:26:59.000+0000 7f638e371380 -1 librbd: Forced V1 image creation. 2023-12-06T15:26:59.004 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 -s 1 bar 2023-12-06T15:26:59.044 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rename foo foo2 2023-12-06T15:26:59.089 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rename foo2 bar 2023-12-06T15:26:59.089 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep exists 2023-12-06T15:26:59.124 INFO:tasks.workunit.client.0.smithi123.stdout:2023-12-06T15:26:59.121+0000 7f6405673380 -1 librbd::Operations: rbd image bar already exists 2023-12-06T15:26:59.124 INFO:tasks.workunit.client.0.smithi123.stdout:rbd: rename error: (17) File exists 2023-12-06T15:26:59.125 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rename bar bar2 2023-12-06T15:26:59.177 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rename bar2 foo2 2023-12-06T15:26:59.178 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep exists 2023-12-06T15:26:59.212 INFO:tasks.workunit.client.0.smithi123.stdout:2023-12-06T15:26:59.209+0000 7f11420c9380 -1 librbd::Operations: rbd image foo2 already exists 2023-12-06T15:26:59.212 INFO:tasks.workunit.client.0.smithi123.stdout:rbd: rename error: (17) File exists 2023-12-06T15:26:59.213 INFO:tasks.workunit.client.0.smithi123.stderr:+ ceph osd pool create rbd2 8 2023-12-06T15:27:00.455 INFO:tasks.workunit.client.0.smithi123.stderr:pool 'rbd2' already exists 2023-12-06T15:27:00.464 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd pool init rbd2 2023-12-06T15:27:03.199 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create -p rbd2 -s 1 foo 2023-12-06T15:27:03.232 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:03.232+0000 7f3c7fe70380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:05.213 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rename rbd2/foo rbd2/bar 2023-12-06T15:27:05.264 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd -p rbd2 ls 2023-12-06T15:27:05.264 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep bar 2023-12-06T15:27:05.293 INFO:tasks.workunit.client.0.smithi123.stdout:bar 2023-12-06T15:27:05.293 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rename rbd2/bar foo 2023-12-06T15:27:05.333 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rename --pool rbd2 foo bar 2023-12-06T15:27:05.378 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rename rbd2/bar --dest-pool rbd foo 2023-12-06T15:27:05.399 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: mv/rename across pools not supported 2023-12-06T15:27:05.399 INFO:tasks.workunit.client.0.smithi123.stderr:source pool: rbd2 dest pool: rbd 2023-12-06T15:27:05.400 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rename --pool rbd2 bar --dest-pool rbd2 foo 2023-12-06T15:27:05.650 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd -p rbd2 ls 2023-12-06T15:27:05.650 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep foo 2023-12-06T15:27:05.677 INFO:tasks.workunit.client.0.smithi123.stdout:foo 2023-12-06T15:27:05.678 INFO:tasks.workunit.client.0.smithi123.stderr:+ ceph osd pool rm rbd2 rbd2 --yes-i-really-really-mean-it 2023-12-06T15:27:06.318 INFO:tasks.workunit.client.0.smithi123.stderr:pool 'rbd2' does not exist 2023-12-06T15:27:06.327 INFO:tasks.workunit.client.0.smithi123.stderr:+ remove_images 2023-12-06T15:27:06.327 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:06.400 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:06.467 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:06.532 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:06.598 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:06.664 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:06.729 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:06.794 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:06.860 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:06.925 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:06.992 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:07.068 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:07.338 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:07.461 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:07.527 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:07.594 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:07.661 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:07.728 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:07.794 INFO:tasks.workunit.client.0.smithi123.stderr:+ test_ls 2023-12-06T15:27:07.794 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 'testing ls...' 2023-12-06T15:27:07.794 INFO:tasks.workunit.client.0.smithi123.stdout:testing ls... 2023-12-06T15:27:07.798 INFO:tasks.workunit.client.0.smithi123.stderr:+ remove_images 2023-12-06T15:27:07.798 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:07.861 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:07.927 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:07.997 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:08.066 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:08.133 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:08.209 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:08.277 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:08.344 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:08.410 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:08.476 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:08.548 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:08.614 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:08.681 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:08.746 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:08.812 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:08.883 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:08.949 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:09.015 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 1 -s 1 test1 2023-12-06T15:27:09.038 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: image format 1 is deprecated 2023-12-06T15:27:09.043 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:09.043+0000 7f2cce9d9380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:09.049 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 1 -s 1 test2 2023-12-06T15:27:09.071 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: image format 1 is deprecated 2023-12-06T15:27:09.076 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:09.077+0000 7f383c0bd380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:09.081 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:27:09.081 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep test1 2023-12-06T15:27:09.107 INFO:tasks.workunit.client.0.smithi123.stdout:test1 2023-12-06T15:27:09.107 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:27:09.107 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep test2 2023-12-06T15:27:09.132 INFO:tasks.workunit.client.0.smithi123.stdout:test2 2023-12-06T15:27:09.133 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:27:09.133 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:27:09.133 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 2 2023-12-06T15:27:09.158 INFO:tasks.workunit.client.0.smithi123.stdout:2 2023-12-06T15:27:09.158 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls -l 2023-12-06T15:27:09.158 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'test1.*1 MiB.*1' 2023-12-06T15:27:09.191 INFO:tasks.workunit.client.0.smithi123.stdout:test1 1 MiB 1 2023-12-06T15:27:09.191 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls -l 2023-12-06T15:27:09.191 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'test2.*1 MiB.*1' 2023-12-06T15:27:09.224 INFO:tasks.workunit.client.0.smithi123.stdout:test2 1 MiB 1 2023-12-06T15:27:09.224 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test1 2023-12-06T15:27:09.261 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:09.263 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test2 2023-12-06T15:27:09.296 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:09.299 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 -s 1 test1 2023-12-06T15:27:09.340 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 -s 1 test2 2023-12-06T15:27:09.383 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:27:09.383 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep test1 2023-12-06T15:27:09.408 INFO:tasks.workunit.client.0.smithi123.stdout:test1 2023-12-06T15:27:09.409 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:27:09.409 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep test2 2023-12-06T15:27:09.434 INFO:tasks.workunit.client.0.smithi123.stdout:test2 2023-12-06T15:27:09.434 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:27:09.434 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:27:09.435 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 2 2023-12-06T15:27:09.459 INFO:tasks.workunit.client.0.smithi123.stdout:2 2023-12-06T15:27:09.460 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls -l 2023-12-06T15:27:09.460 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'test1.*1 MiB.*2' 2023-12-06T15:27:09.494 INFO:tasks.workunit.client.0.smithi123.stdout:test1 1 MiB 2 2023-12-06T15:27:09.494 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls -l 2023-12-06T15:27:09.494 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'test2.*1 MiB.*2' 2023-12-06T15:27:09.529 INFO:tasks.workunit.client.0.smithi123.stdout:test2 1 MiB 2 2023-12-06T15:27:09.529 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test1 2023-12-06T15:27:09.610 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:09.610+0000 7fe4011df700 0 -- 172.21.15.123:0/1210668085 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x55cb0e4ae700 msgr2=0x55cb0e552f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:09.614 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:09.616 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test2 2023-12-06T15:27:09.701 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:09.704 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 -s 1 test1 2023-12-06T15:27:09.746 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 1 -s 1 test2 2023-12-06T15:27:09.769 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: image format 1 is deprecated 2023-12-06T15:27:09.774 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:09.775+0000 7fa93cc0d380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:09.781 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:27:09.781 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep test1 2023-12-06T15:27:09.807 INFO:tasks.workunit.client.0.smithi123.stdout:test1 2023-12-06T15:27:09.807 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:27:09.807 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep test2 2023-12-06T15:27:09.833 INFO:tasks.workunit.client.0.smithi123.stdout:test2 2023-12-06T15:27:09.833 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:27:09.833 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:27:09.833 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 2 2023-12-06T15:27:09.859 INFO:tasks.workunit.client.0.smithi123.stdout:2 2023-12-06T15:27:09.859 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls -l 2023-12-06T15:27:09.859 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'test1.*1 MiB.*2' 2023-12-06T15:27:09.893 INFO:tasks.workunit.client.0.smithi123.stdout:test1 1 MiB 2 2023-12-06T15:27:09.893 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls -l 2023-12-06T15:27:09.893 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'test2.*1 MiB.*1' 2023-12-06T15:27:09.926 INFO:tasks.workunit.client.0.smithi123.stdout:test2 1 MiB 1 2023-12-06T15:27:09.927 INFO:tasks.workunit.client.0.smithi123.stderr:+ remove_images 2023-12-06T15:27:09.927 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:10.000 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:10.071 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:10.144 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:10.218 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:10.291 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:10.363 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:10.429 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:10.495 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:10.561 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:10.627 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:10.693 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:10.759 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:10.827 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:10.970 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:11.042 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:11.115 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:11.187 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:11.255 INFO:tasks.workunit.client.0.smithi123.stderr:++ seq -w 00 99 2023-12-06T15:27:11.264 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:11.264 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.00 -s 1 2023-12-06T15:27:11.291 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:11.291+0000 7f83904a5380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:11.296 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:11.296 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.01 -s 1 2023-12-06T15:27:11.323 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:11.323+0000 7efedd2b6380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:11.328 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:11.328 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.02 -s 1 2023-12-06T15:27:11.354 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:11.355+0000 7f8854f27380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:11.360 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:11.360 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.03 -s 1 2023-12-06T15:27:11.386 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:11.387+0000 7f3b8f865380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:11.392 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:11.392 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.04 -s 1 2023-12-06T15:27:11.418 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:11.419+0000 7f48301b9380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:11.423 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:11.423 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.05 -s 1 2023-12-06T15:27:11.450 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:11.450+0000 7f0a9714a380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:11.455 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:11.455 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.06 -s 1 2023-12-06T15:27:11.482 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:11.482+0000 7f1844fef380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:11.487 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:11.487 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.07 -s 1 2023-12-06T15:27:11.514 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:11.514+0000 7f9550cf4380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:11.519 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:11.520 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.08 -s 1 2023-12-06T15:27:11.546 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:11.546+0000 7f6c048c2380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:11.551 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:11.551 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.09 -s 1 2023-12-06T15:27:11.578 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:11.579+0000 7f8623d4b380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:11.584 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:11.584 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.10 -s 1 2023-12-06T15:27:11.611 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:11.611+0000 7f3bb0ea6380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:11.619 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:11.619 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.11 -s 1 2023-12-06T15:27:11.646 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:11.646+0000 7f370e38f380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:11.652 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:11.652 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.12 -s 1 2023-12-06T15:27:11.678 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:11.678+0000 7f7df8973380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:11.690 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:11.690 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.13 -s 1 2023-12-06T15:27:11.717 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:11.717+0000 7fee30405380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:11.728 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:11.728 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.14 -s 1 2023-12-06T15:27:11.754 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:11.754+0000 7f05aacab380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:11.763 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:11.763 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.15 -s 1 2023-12-06T15:27:11.789 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:11.790+0000 7f6188f96380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:11.796 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:11.796 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.16 -s 1 2023-12-06T15:27:11.823 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:11.823+0000 7f3810c18380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:11.829 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:11.830 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.17 -s 1 2023-12-06T15:27:11.857 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:11.857+0000 7f5fd41cf380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:11.866 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:11.866 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.18 -s 1 2023-12-06T15:27:11.892 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:11.893+0000 7f6bfa845380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:11.901 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:11.901 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.19 -s 1 2023-12-06T15:27:11.928 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:11.929+0000 7eff79790380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:11.939 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:11.939 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.20 -s 1 2023-12-06T15:27:11.965 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:11.965+0000 7f40621d2380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:11.975 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:11.975 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.21 -s 1 2023-12-06T15:27:12.002 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:12.002+0000 7fe4a209a380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:12.012 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:12.012 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.22 -s 1 2023-12-06T15:27:12.039 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:12.039+0000 7f7c7cd68380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:12.047 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:12.047 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.23 -s 1 2023-12-06T15:27:12.074 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:12.074+0000 7f43d2906380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:12.079 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:12.079 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.24 -s 1 2023-12-06T15:27:12.106 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:12.106+0000 7fbc4ce41380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:12.114 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:12.114 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.25 -s 1 2023-12-06T15:27:12.138 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:12.138+0000 7feb51d84380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:12.143 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:12.143 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.26 -s 1 2023-12-06T15:27:12.170 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:12.170+0000 7f68e2986380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:12.175 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:12.175 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.27 -s 1 2023-12-06T15:27:12.202 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:12.202+0000 7f38fb2f1380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:12.207 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:12.207 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.28 -s 1 2023-12-06T15:27:12.234 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:12.234+0000 7f23513c5380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:12.239 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:12.239 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.29 -s 1 2023-12-06T15:27:12.266 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:12.266+0000 7f3696e7b380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:12.271 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:12.271 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.30 -s 1 2023-12-06T15:27:12.297 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:12.298+0000 7f8644063380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:12.303 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:12.303 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.31 -s 1 2023-12-06T15:27:12.329 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:12.330+0000 7f0d52edc380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:12.335 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:12.335 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.32 -s 1 2023-12-06T15:27:12.362 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:12.362+0000 7fb5aede3380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:12.367 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:12.367 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.33 -s 1 2023-12-06T15:27:12.393 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:12.394+0000 7fdcfe0fa380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:12.404 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:12.404 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.34 -s 1 2023-12-06T15:27:12.431 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:12.431+0000 7fc089b61380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:12.442 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:12.442 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.35 -s 1 2023-12-06T15:27:12.469 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:12.470+0000 7fa12cf8e380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:12.474 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:12.474 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.36 -s 1 2023-12-06T15:27:12.701 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:12.701+0000 7f4719076380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:12.708 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:12.708 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.37 -s 1 2023-12-06T15:27:12.734 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:12.735+0000 7f79119a1380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:12.742 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:12.742 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.38 -s 1 2023-12-06T15:27:12.768 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:12.769+0000 7fd953c4c380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:12.776 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:12.776 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.39 -s 1 2023-12-06T15:27:12.803 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:12.803+0000 7f71a3e07380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:12.810 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:12.810 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.40 -s 1 2023-12-06T15:27:12.837 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:12.837+0000 7fc63c60d380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:12.846 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:12.846 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.41 -s 1 2023-12-06T15:27:12.873 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:12.874+0000 7f6e9a521380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:12.881 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:12.881 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.42 -s 1 2023-12-06T15:27:12.908 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:12.909+0000 7fec12b7f380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:12.914 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:12.914 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.43 -s 1 2023-12-06T15:27:12.940 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:12.940+0000 7f96d89b4380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:12.946 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:12.946 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.44 -s 1 2023-12-06T15:27:12.972 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:12.972+0000 7f1a8edc7380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:12.979 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:12.979 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.45 -s 1 2023-12-06T15:27:13.005 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:13.006+0000 7f85be4c0380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:13.013 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:13.013 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.46 -s 1 2023-12-06T15:27:13.039 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:13.040+0000 7fdf48561380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:13.045 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:13.045 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.47 -s 1 2023-12-06T15:27:13.072 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:13.073+0000 7f7eee51d380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:13.080 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:13.080 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.48 -s 1 2023-12-06T15:27:13.107 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:13.107+0000 7fa311ba7380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:13.118 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:13.118 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.49 -s 1 2023-12-06T15:27:13.146 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:13.146+0000 7f90c1704380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:13.152 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:13.153 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.50 -s 1 2023-12-06T15:27:13.180 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:13.180+0000 7f9d30bee380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:13.185 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:13.185 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.51 -s 1 2023-12-06T15:27:13.212 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:13.213+0000 7f05595a1380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:13.218 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:13.218 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.52 -s 1 2023-12-06T15:27:13.244 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:13.244+0000 7f6d354c3380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:13.249 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:13.250 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.53 -s 1 2023-12-06T15:27:13.277 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:13.277+0000 7fcc4c6bf380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:13.282 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:13.282 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.54 -s 1 2023-12-06T15:27:13.308 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:13.309+0000 7f539da0c380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:13.314 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:13.314 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.55 -s 1 2023-12-06T15:27:13.344 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:13.341+0000 7f88c67be380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:13.346 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:13.346 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.56 -s 1 2023-12-06T15:27:13.373 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:13.373+0000 7f01870d3380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:13.380 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:13.380 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.57 -s 1 2023-12-06T15:27:13.407 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:13.407+0000 7fed3b305380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:13.415 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:13.416 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.58 -s 1 2023-12-06T15:27:13.442 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:13.443+0000 7f0071b4f380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:13.449 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:13.450 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.59 -s 1 2023-12-06T15:27:13.475 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:13.476+0000 7f09158ca380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:13.482 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:13.482 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.60 -s 1 2023-12-06T15:27:13.510 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:13.509+0000 7fbab4951380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:13.514 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:13.514 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.61 -s 1 2023-12-06T15:27:13.541 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:13.541+0000 7fbfff9d6380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:13.546 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:13.546 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.62 -s 1 2023-12-06T15:27:13.573 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:13.573+0000 7f98efcc5380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:13.582 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:13.582 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.63 -s 1 2023-12-06T15:27:13.608 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:13.608+0000 7fcfcb9b9380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:13.614 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:13.615 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.64 -s 1 2023-12-06T15:27:13.642 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:13.642+0000 7f4809047380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:13.655 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:13.655 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.65 -s 1 2023-12-06T15:27:13.681 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:13.681+0000 7f2057770380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:13.692 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:13.692 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.66 -s 1 2023-12-06T15:27:13.719 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:13.719+0000 7f0699569380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:13.727 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:13.727 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.67 -s 1 2023-12-06T15:27:13.754 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:13.754+0000 7fd957876380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:13.762 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:13.762 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.68 -s 1 2023-12-06T15:27:13.789 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:13.790+0000 7f37115ba380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:13.805 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:13.805 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.69 -s 1 2023-12-06T15:27:13.832 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:13.832+0000 7f7d4b4a1380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:13.843 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:13.843 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.70 -s 1 2023-12-06T15:27:13.870 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:13.870+0000 7f4a14d33380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:13.877 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:13.877 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.71 -s 1 2023-12-06T15:27:13.904 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:13.904+0000 7fe6b6cd7380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:13.909 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:13.909 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.72 -s 1 2023-12-06T15:27:13.935 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:13.936+0000 7f35922bf380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:13.941 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:13.941 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.73 -s 1 2023-12-06T15:27:13.968 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:13.968+0000 7f77c11c2380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:13.974 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:13.974 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.74 -s 1 2023-12-06T15:27:14.000 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:14.001+0000 7f0a05c87380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:14.007 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:14.007 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.75 -s 1 2023-12-06T15:27:14.034 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:14.034+0000 7f7fba5f2380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:14.041 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:14.041 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.76 -s 1 2023-12-06T15:27:14.067 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:14.068+0000 7fe9f88cf380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:14.073 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:14.073 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.77 -s 1 2023-12-06T15:27:14.100 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:14.101+0000 7f9818387380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:14.109 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:14.109 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.78 -s 1 2023-12-06T15:27:14.136 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:14.136+0000 7fd1e73c0380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:14.144 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:14.144 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.79 -s 1 2023-12-06T15:27:14.171 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:14.171+0000 7f28f4295380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:14.178 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:14.178 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.80 -s 1 2023-12-06T15:27:14.205 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:14.205+0000 7fce87961380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:14.212 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:14.212 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.81 -s 1 2023-12-06T15:27:14.239 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:14.239+0000 7fc51b4f4380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:14.245 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:14.245 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.82 -s 1 2023-12-06T15:27:14.272 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:14.272+0000 7f745376c380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:14.281 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:14.281 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.83 -s 1 2023-12-06T15:27:14.308 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:14.308+0000 7f97e2f57380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:14.315 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:14.315 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.84 -s 1 2023-12-06T15:27:14.341 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:14.341+0000 7f58ff956380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:14.353 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:14.354 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.85 -s 1 2023-12-06T15:27:14.380 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:14.380+0000 7f65d9dd4380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:14.386 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:14.386 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.86 -s 1 2023-12-06T15:27:14.414 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:14.414+0000 7f2d2c31a380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:14.422 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:14.422 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.87 -s 1 2023-12-06T15:27:14.449 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:14.449+0000 7f5efe470380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:14.455 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:14.455 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.88 -s 1 2023-12-06T15:27:14.482 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:14.482+0000 7f409cb15380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:14.488 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:14.488 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.89 -s 1 2023-12-06T15:27:14.514 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:14.515+0000 7fbbda33f380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:14.522 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:14.522 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.90 -s 1 2023-12-06T15:27:14.549 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:14.549+0000 7f92ed676380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:14.554 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:14.555 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.91 -s 1 2023-12-06T15:27:14.581 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:14.582+0000 7f5a0151c380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:14.587 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:14.587 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.92 -s 1 2023-12-06T15:27:14.613 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:14.614+0000 7f1c4d8e9380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:14.620 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:14.620 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.93 -s 1 2023-12-06T15:27:14.646 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:14.647+0000 7fc521c0b380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:14.653 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:14.654 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.94 -s 1 2023-12-06T15:27:14.680 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:14.680+0000 7f6209395380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:14.691 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:14.691 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.95 -s 1 2023-12-06T15:27:14.718 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:14.718+0000 7f863178a380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:14.727 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:14.727 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.96 -s 1 2023-12-06T15:27:14.754 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:14.754+0000 7fa483056380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:14.760 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:14.760 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.97 -s 1 2023-12-06T15:27:14.786 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:14.787+0000 7f771c952380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:14.792 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:14.793 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.98 -s 1 2023-12-06T15:27:14.820 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:14.820+0000 7fd62bb88380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:14.832 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:14.832 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.99 -s 1 2023-12-06T15:27:14.860 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:14.860+0000 7ff3a36af380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:14.865 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:27:14.865 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:27:14.865 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 100 2023-12-06T15:27:15.092 INFO:tasks.workunit.client.0.smithi123.stdout:100 2023-12-06T15:27:15.093 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls -l 2023-12-06T15:27:15.093 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep image 2023-12-06T15:27:15.093 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:27:15.093 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 100 2023-12-06T15:27:15.159 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:15.159+0000 7f717ff24700 0 -- 172.21.15.123:0/124541765 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x560dbd9c1e60 msgr2=0x560dbda5ffb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:15.169 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:15.170+0000 7f717ff24700 0 -- 172.21.15.123:0/124541765 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7f7164036510 msgr2=0x7f7164038940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T15:27:15.341 INFO:tasks.workunit.client.0.smithi123.stdout:100 2023-12-06T15:27:15.341 INFO:tasks.workunit.client.0.smithi123.stderr:++ seq -w 00 99 2023-12-06T15:27:15.342 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:15.342 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.00 2023-12-06T15:27:15.378 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:15.381 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:15.381 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.01 2023-12-06T15:27:15.415 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:15.418 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:15.418 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.02 2023-12-06T15:27:15.453 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:15.455 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:15.455 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.03 2023-12-06T15:27:15.492 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:15.495 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:15.495 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.04 2023-12-06T15:27:15.544 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:15.546 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:15.546 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.05 2023-12-06T15:27:15.589 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:15.592 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:15.592 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.06 2023-12-06T15:27:15.629 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:15.632 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:15.632 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.07 2023-12-06T15:27:15.668 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:15.671 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:15.671 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.08 2023-12-06T15:27:15.711 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:15.713 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:15.713 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.09 2023-12-06T15:27:15.747 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:15.750 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:15.750 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.10 2023-12-06T15:27:15.784 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:15.786 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:15.787 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.11 2023-12-06T15:27:15.821 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:15.823 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:15.823 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.12 2023-12-06T15:27:15.857 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:15.860 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:15.860 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.13 2023-12-06T15:27:15.898 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:15.900 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:15.900 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.14 2023-12-06T15:27:15.938 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:15.941 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:15.941 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.15 2023-12-06T15:27:15.978 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:15.980 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:15.980 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.16 2023-12-06T15:27:16.018 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:16.021 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:16.021 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.17 2023-12-06T15:27:16.056 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:16.058 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:16.058 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.18 2023-12-06T15:27:16.094 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:16.096 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:16.097 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.19 2023-12-06T15:27:16.132 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:16.134 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:16.134 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.20 2023-12-06T15:27:16.175 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:16.177 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:16.177 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.21 2023-12-06T15:27:16.216 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:16.219 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:16.219 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.22 2023-12-06T15:27:16.269 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:16.271 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:16.271 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.23 2023-12-06T15:27:16.311 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:16.314 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:16.314 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.24 2023-12-06T15:27:16.349 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:16.351 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:16.351 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.25 2023-12-06T15:27:16.388 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:16.390 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:16.390 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.26 2023-12-06T15:27:16.427 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:16.429 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:16.429 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.27 2023-12-06T15:27:16.466 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:16.468 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:16.468 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.28 2023-12-06T15:27:16.503 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:16.505 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:16.505 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.29 2023-12-06T15:27:16.542 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:16.545 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:16.545 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.30 2023-12-06T15:27:16.582 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:16.584 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:16.584 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.31 2023-12-06T15:27:16.625 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:16.627 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:16.627 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.32 2023-12-06T15:27:16.665 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:16.667 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:16.667 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.33 2023-12-06T15:27:16.704 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:16.706 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:16.706 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.34 2023-12-06T15:27:16.744 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:16.746 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:16.747 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.35 2023-12-06T15:27:16.781 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:16.783 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:16.783 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.36 2023-12-06T15:27:16.819 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:16.822 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:16.822 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.37 2023-12-06T15:27:16.867 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:16.869 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:16.869 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.38 2023-12-06T15:27:16.906 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:16.909 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:16.909 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.39 2023-12-06T15:27:16.943 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:16.946 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:16.946 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.40 2023-12-06T15:27:16.985 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:16.988 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:16.988 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.41 2023-12-06T15:27:17.023 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:17.026 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:17.026 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.42 2023-12-06T15:27:17.067 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:17.069 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:17.069 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.43 2023-12-06T15:27:17.109 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:17.112 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:17.112 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.44 2023-12-06T15:27:17.157 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:17.159 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:17.159 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.45 2023-12-06T15:27:17.204 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:17.206 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:17.206 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.46 2023-12-06T15:27:17.241 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:17.243 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:17.243 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.47 2023-12-06T15:27:17.279 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:17.281 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:17.281 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.48 2023-12-06T15:27:17.327 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:17.329 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:17.329 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.49 2023-12-06T15:27:17.365 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:17.367 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:17.368 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.50 2023-12-06T15:27:17.405 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:17.407 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:17.407 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.51 2023-12-06T15:27:17.445 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:17.447 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:17.447 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.52 2023-12-06T15:27:17.487 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:17.490 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:17.490 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.53 2023-12-06T15:27:17.527 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:17.529 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:17.529 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.54 2023-12-06T15:27:17.567 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:17.569 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:17.570 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.55 2023-12-06T15:27:17.604 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:17.695 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:17.695 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.56 2023-12-06T15:27:17.695 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:17.696 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:17.696 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.57 2023-12-06T15:27:17.696 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:17.696 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:17.696 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.58 2023-12-06T15:27:17.722 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:17.725 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:17.725 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.59 2023-12-06T15:27:17.759 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:17.761 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:17.761 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.60 2023-12-06T15:27:17.796 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:17.798 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:17.798 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.61 2023-12-06T15:27:17.832 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:17.834 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:17.835 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.62 2023-12-06T15:27:17.878 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:17.881 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:17.881 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.63 2023-12-06T15:27:17.921 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:17.923 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:17.924 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.64 2023-12-06T15:27:17.959 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:17.961 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:17.961 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.65 2023-12-06T15:27:18.006 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:18.008 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:18.008 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.66 2023-12-06T15:27:18.049 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:18.050 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:18.050 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.67 2023-12-06T15:27:18.084 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:18.086 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:18.086 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.68 2023-12-06T15:27:18.121 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:18.123 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:18.123 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.69 2023-12-06T15:27:18.160 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:18.163 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:18.163 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.70 2023-12-06T15:27:18.199 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:18.201 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:18.201 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.71 2023-12-06T15:27:18.238 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:18.241 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:18.241 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.72 2023-12-06T15:27:18.278 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:18.280 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:18.280 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.73 2023-12-06T15:27:18.321 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:18.323 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:18.324 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.74 2023-12-06T15:27:18.365 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:18.367 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:18.367 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.75 2023-12-06T15:27:18.404 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:18.406 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:18.406 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.76 2023-12-06T15:27:18.446 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:18.449 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:18.449 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.77 2023-12-06T15:27:18.484 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:18.487 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:18.487 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.78 2023-12-06T15:27:18.524 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:18.527 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:18.527 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.79 2023-12-06T15:27:18.570 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:18.572 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:18.572 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.80 2023-12-06T15:27:18.617 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:18.619 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:18.619 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.81 2023-12-06T15:27:18.667 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:18.670 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:18.670 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.82 2023-12-06T15:27:18.708 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:18.710 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:18.710 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.83 2023-12-06T15:27:18.746 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:18.748 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:18.748 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.84 2023-12-06T15:27:18.784 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:18.786 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:18.786 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.85 2023-12-06T15:27:18.822 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:18.825 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:18.825 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.86 2023-12-06T15:27:18.863 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:18.865 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:18.865 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.87 2023-12-06T15:27:18.900 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:18.902 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:18.902 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.88 2023-12-06T15:27:18.936 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:18.938 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:18.938 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.89 2023-12-06T15:27:18.973 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:18.975 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:18.975 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.90 2023-12-06T15:27:19.023 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:19.025 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:19.026 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.91 2023-12-06T15:27:19.064 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:19.066 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:19.066 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.92 2023-12-06T15:27:19.103 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:19.105 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:19.105 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.93 2023-12-06T15:27:19.140 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:19.143 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:19.143 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.94 2023-12-06T15:27:19.177 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:19.180 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:19.180 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.95 2023-12-06T15:27:19.215 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:19.217 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:19.217 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.96 2023-12-06T15:27:19.265 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:19.267 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:19.267 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.97 2023-12-06T15:27:19.307 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:19.309 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:19.310 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.98 2023-12-06T15:27:19.352 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:19.354 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:19.355 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.99 2023-12-06T15:27:19.593 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:19.595 INFO:tasks.workunit.client.0.smithi123.stderr:++ seq -w 00 99 2023-12-06T15:27:19.596 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:19.596 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.00 --image-format 2 -s 1 2023-12-06T15:27:19.636 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:19.636 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.01 --image-format 2 -s 1 2023-12-06T15:27:19.677 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:19.677 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.02 --image-format 2 -s 1 2023-12-06T15:27:19.718 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:19.718 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.03 --image-format 2 -s 1 2023-12-06T15:27:19.758 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:19.758 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.04 --image-format 2 -s 1 2023-12-06T15:27:19.801 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:19.801 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.05 --image-format 2 -s 1 2023-12-06T15:27:19.840 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:19.840 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.06 --image-format 2 -s 1 2023-12-06T15:27:19.881 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:19.882 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.07 --image-format 2 -s 1 2023-12-06T15:27:19.920 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:19.921 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.08 --image-format 2 -s 1 2023-12-06T15:27:19.961 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:19.961 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.09 --image-format 2 -s 1 2023-12-06T15:27:20.002 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:20.003 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.10 --image-format 2 -s 1 2023-12-06T15:27:20.042 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:20.042 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.11 --image-format 2 -s 1 2023-12-06T15:27:20.082 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:20.083 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.12 --image-format 2 -s 1 2023-12-06T15:27:20.131 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:20.131 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.13 --image-format 2 -s 1 2023-12-06T15:27:20.172 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:20.172 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.14 --image-format 2 -s 1 2023-12-06T15:27:20.215 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:20.215 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.15 --image-format 2 -s 1 2023-12-06T15:27:20.257 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:20.257 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.16 --image-format 2 -s 1 2023-12-06T15:27:20.297 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:20.298 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.17 --image-format 2 -s 1 2023-12-06T15:27:20.338 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:20.339 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.18 --image-format 2 -s 1 2023-12-06T15:27:20.379 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:20.380 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.19 --image-format 2 -s 1 2023-12-06T15:27:20.426 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:20.426 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.20 --image-format 2 -s 1 2023-12-06T15:27:20.469 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:20.469 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.21 --image-format 2 -s 1 2023-12-06T15:27:20.509 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:20.509 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.22 --image-format 2 -s 1 2023-12-06T15:27:20.549 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:20.549 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.23 --image-format 2 -s 1 2023-12-06T15:27:20.599 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:20.600 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.24 --image-format 2 -s 1 2023-12-06T15:27:20.642 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:20.642 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.25 --image-format 2 -s 1 2023-12-06T15:27:20.683 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:20.683 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.26 --image-format 2 -s 1 2023-12-06T15:27:20.723 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:20.723 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.27 --image-format 2 -s 1 2023-12-06T15:27:20.775 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:20.775 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.28 --image-format 2 -s 1 2023-12-06T15:27:20.817 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:20.817 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.29 --image-format 2 -s 1 2023-12-06T15:27:20.864 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:20.865 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.30 --image-format 2 -s 1 2023-12-06T15:27:20.905 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:20.905 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.31 --image-format 2 -s 1 2023-12-06T15:27:20.946 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:20.947 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.32 --image-format 2 -s 1 2023-12-06T15:27:20.988 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:20.988 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.33 --image-format 2 -s 1 2023-12-06T15:27:21.032 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:21.032 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.34 --image-format 2 -s 1 2023-12-06T15:27:21.075 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:21.076 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.35 --image-format 2 -s 1 2023-12-06T15:27:21.120 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:21.120 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.36 --image-format 2 -s 1 2023-12-06T15:27:21.162 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:21.162 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.37 --image-format 2 -s 1 2023-12-06T15:27:21.204 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:21.204 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.38 --image-format 2 -s 1 2023-12-06T15:27:21.243 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:21.243 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.39 --image-format 2 -s 1 2023-12-06T15:27:21.285 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:21.285 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.40 --image-format 2 -s 1 2023-12-06T15:27:21.328 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:21.328 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.41 --image-format 2 -s 1 2023-12-06T15:27:21.370 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:21.371 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.42 --image-format 2 -s 1 2023-12-06T15:27:21.416 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:21.416 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.43 --image-format 2 -s 1 2023-12-06T15:27:21.458 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:21.458 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.44 --image-format 2 -s 1 2023-12-06T15:27:21.498 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:21.498 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.45 --image-format 2 -s 1 2023-12-06T15:27:21.540 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:21.540 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.46 --image-format 2 -s 1 2023-12-06T15:27:21.580 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:21.581 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.47 --image-format 2 -s 1 2023-12-06T15:27:21.621 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:21.621 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.48 --image-format 2 -s 1 2023-12-06T15:27:21.661 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:21.661 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.49 --image-format 2 -s 1 2023-12-06T15:27:21.703 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:21.703 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.50 --image-format 2 -s 1 2023-12-06T15:27:21.746 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:21.746 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.51 --image-format 2 -s 1 2023-12-06T15:27:21.796 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:21.796 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.52 --image-format 2 -s 1 2023-12-06T15:27:21.836 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:21.836 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.53 --image-format 2 -s 1 2023-12-06T15:27:21.875 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:21.875 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.54 --image-format 2 -s 1 2023-12-06T15:27:21.914 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:21.914 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.55 --image-format 2 -s 1 2023-12-06T15:27:21.955 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:21.956 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.56 --image-format 2 -s 1 2023-12-06T15:27:21.997 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:21.997 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.57 --image-format 2 -s 1 2023-12-06T15:27:22.038 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:22.038 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.58 --image-format 2 -s 1 2023-12-06T15:27:22.083 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:22.083 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.59 --image-format 2 -s 1 2023-12-06T15:27:22.123 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:22.124 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.60 --image-format 2 -s 1 2023-12-06T15:27:22.165 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:22.165 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.61 --image-format 2 -s 1 2023-12-06T15:27:22.209 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:22.210 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.62 --image-format 2 -s 1 2023-12-06T15:27:22.255 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:22.255 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.63 --image-format 2 -s 1 2023-12-06T15:27:22.296 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:22.297 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.64 --image-format 2 -s 1 2023-12-06T15:27:22.337 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:22.337 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.65 --image-format 2 -s 1 2023-12-06T15:27:22.381 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:22.381 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.66 --image-format 2 -s 1 2023-12-06T15:27:22.626 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:22.627 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.67 --image-format 2 -s 1 2023-12-06T15:27:22.669 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:22.670 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.68 --image-format 2 -s 1 2023-12-06T15:27:22.709 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:22.710 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.69 --image-format 2 -s 1 2023-12-06T15:27:22.752 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:22.752 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.70 --image-format 2 -s 1 2023-12-06T15:27:22.794 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:22.794 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.71 --image-format 2 -s 1 2023-12-06T15:27:22.849 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:22.849 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.72 --image-format 2 -s 1 2023-12-06T15:27:22.873 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:22.874 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.73 --image-format 2 -s 1 2023-12-06T15:27:22.916 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:22.916 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.74 --image-format 2 -s 1 2023-12-06T15:27:22.956 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:22.956 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.75 --image-format 2 -s 1 2023-12-06T15:27:22.999 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:22.999 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.76 --image-format 2 -s 1 2023-12-06T15:27:23.041 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:23.041 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.77 --image-format 2 -s 1 2023-12-06T15:27:23.281 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:23.281 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.78 --image-format 2 -s 1 2023-12-06T15:27:23.321 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:23.322 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.79 --image-format 2 -s 1 2023-12-06T15:27:23.361 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:23.361 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.80 --image-format 2 -s 1 2023-12-06T15:27:23.401 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:23.401 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.81 --image-format 2 -s 1 2023-12-06T15:27:23.444 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:23.444 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.82 --image-format 2 -s 1 2023-12-06T15:27:23.487 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:23.487 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.83 --image-format 2 -s 1 2023-12-06T15:27:23.528 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:23.528 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.84 --image-format 2 -s 1 2023-12-06T15:27:23.568 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:23.568 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.85 --image-format 2 -s 1 2023-12-06T15:27:23.809 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:23.809 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.86 --image-format 2 -s 1 2023-12-06T15:27:23.850 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:23.850 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.87 --image-format 2 -s 1 2023-12-06T15:27:23.888 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:23.888 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.88 --image-format 2 -s 1 2023-12-06T15:27:23.931 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:23.931 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.89 --image-format 2 -s 1 2023-12-06T15:27:23.971 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:23.972 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.90 --image-format 2 -s 1 2023-12-06T15:27:24.010 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:24.010 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.91 --image-format 2 -s 1 2023-12-06T15:27:24.049 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:24.049 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.92 --image-format 2 -s 1 2023-12-06T15:27:24.094 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:24.094 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.93 --image-format 2 -s 1 2023-12-06T15:27:24.137 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:24.138 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.94 --image-format 2 -s 1 2023-12-06T15:27:24.180 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:24.180 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.95 --image-format 2 -s 1 2023-12-06T15:27:24.219 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:24.219 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.96 --image-format 2 -s 1 2023-12-06T15:27:24.260 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:24.260 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.97 --image-format 2 -s 1 2023-12-06T15:27:24.302 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:24.302 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.98 --image-format 2 -s 1 2023-12-06T15:27:24.341 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:24.341 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create image.99 --image-format 2 -s 1 2023-12-06T15:27:24.380 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:27:24.380 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:27:24.380 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 100 2023-12-06T15:27:24.407 INFO:tasks.workunit.client.0.smithi123.stdout:100 2023-12-06T15:27:24.408 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls -l 2023-12-06T15:27:24.408 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep image 2023-12-06T15:27:24.408 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:27:24.408 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 100 2023-12-06T15:27:24.459 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:24.459+0000 7f3f457c6700 0 -- 172.21.15.123:0/2473563346 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x558c2bdbb490 msgr2=0x558c2bdbd880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:24.470 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:24.471+0000 7f3f45fc7700 0 -- 172.21.15.123:0/2473563346 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x558c2bd13ad0 msgr2=0x558c2bd07320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:24.728 INFO:tasks.workunit.client.0.smithi123.stdout:100 2023-12-06T15:27:24.728 INFO:tasks.workunit.client.0.smithi123.stderr:++ seq -w 00 99 2023-12-06T15:27:24.729 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:24.729 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.00 2023-12-06T15:27:24.828 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:24.830 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:24.830 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.01 2023-12-06T15:27:24.929 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:24.931 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:24.931 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.02 2023-12-06T15:27:25.016 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:25.016+0000 7fe40c3ab700 0 -- 172.21.15.123:0/2109939872 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7fe3f0036440 msgr2=0x7fe3f0038870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:25.023 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:25.026 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:25.026 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.03 2023-12-06T15:27:25.136 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:25.139 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:25.139 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.04 2023-12-06T15:27:25.223 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:25.224 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:25.224 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.05 2023-12-06T15:27:25.318 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:25.321 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:25.321 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.06 2023-12-06T15:27:25.425 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:25.427 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:25.427 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.07 2023-12-06T15:27:25.514 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:25.516 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:25.517 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.08 2023-12-06T15:27:25.670 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:25.672 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:25.673 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.09 2023-12-06T15:27:25.770 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:25.773 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:25.773 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.10 2023-12-06T15:27:25.874 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:25.876 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:25.876 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.11 2023-12-06T15:27:25.982 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:25.984 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:25.984 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.12 2023-12-06T15:27:26.093 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:26.096 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:26.096 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.13 2023-12-06T15:27:26.188 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:26.191 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:26.191 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.14 2023-12-06T15:27:26.284 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:26.286 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:26.286 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.15 2023-12-06T15:27:26.383 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:26.385 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:26.385 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.16 2023-12-06T15:27:26.689 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:26.689+0000 7f92a2929700 0 -- 172.21.15.123:0/387480667 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7f92840069c0 msgr2=0x7f9284008db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:26.689 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:26.692 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:26.692 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.17 2023-12-06T15:27:26.785 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:26.787 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:26.787 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.18 2023-12-06T15:27:26.879 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:26.881 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:26.881 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.19 2023-12-06T15:27:26.990 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:26.990+0000 7fcb0aca6700 0 -- 172.21.15.123:0/4051224161 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7fcae8008780 msgr2=0x7fcae800abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:27.001 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:27.004 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:27.004 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.20 2023-12-06T15:27:27.105 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:27.108 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:27.108 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.21 2023-12-06T15:27:27.192 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:27.195 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:27.195 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.22 2023-12-06T15:27:27.303 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:27.306 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:27.306 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.23 2023-12-06T15:27:27.405 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:27.407 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:27.407 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.24 2023-12-06T15:27:27.499 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:27.502 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:27.502 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.25 2023-12-06T15:27:27.605 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:27.605+0000 7fad86016700 0 -- 172.21.15.123:0/2010198045 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7fad68036440 msgr2=0x7fad68038870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:27.611 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:27.614 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:27.614 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.26 2023-12-06T15:27:27.704 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:27.704+0000 7efc7e627700 0 -- 172.21.15.123:0/813065101 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x5613c21a7120 msgr2=0x5613c215eb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:27.704 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:27.707 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:27.707 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.27 2023-12-06T15:27:27.786 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:27.787+0000 7fa5d19d8700 0 -- 172.21.15.123:0/3523379296 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7fa5b4036440 msgr2=0x7fa5b4038870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T15:27:27.791 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:27.794 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:27.794 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.28 2023-12-06T15:27:27.926 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:27.929 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:27.929 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.29 2023-12-06T15:27:28.013 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:28.013+0000 7f3e58716700 0 -- 172.21.15.123:0/1707263960 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x563e12812600 msgr2=0x563e128b30b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:28.014 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:28.017 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:28.017 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.30 2023-12-06T15:27:28.117 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:28.120 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:28.120 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.31 2023-12-06T15:27:28.229 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:28.232 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:28.232 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.32 2023-12-06T15:27:28.313 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:28.314+0000 7fa0f94b7700 0 -- 172.21.15.123:0/2520133118 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7fa0d4008780 msgr2=0x7fa0d400abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:28.314 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:28.316 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:28.316 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.33 2023-12-06T15:27:28.423 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:28.425 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:28.425 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.34 2023-12-06T15:27:28.518 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:28.521 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:28.521 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.35 2023-12-06T15:27:28.632 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:28.635 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:28.635 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.36 2023-12-06T15:27:28.741 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:28.744 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:28.744 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.37 2023-12-06T15:27:28.832 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:28.835 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:28.835 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.38 2023-12-06T15:27:28.945 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:28.948 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:28.948 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.39 2023-12-06T15:27:29.038 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:29.040 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:29.040 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.40 2023-12-06T15:27:29.147 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:29.149 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:29.149 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.41 2023-12-06T15:27:29.239 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:29.241 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:29.241 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.42 2023-12-06T15:27:29.342 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:29.341+0000 7f35409b9700 0 -- 172.21.15.123:0/283251183 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7f3524014cb0 msgr2=0x7f3524011e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:29.342 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:29.345 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:29.345 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.43 2023-12-06T15:27:29.449 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:29.451 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:29.451 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.44 2023-12-06T15:27:29.560 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:29.563 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:29.563 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.45 2023-12-06T15:27:29.650 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:29.654 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:29.654 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.46 2023-12-06T15:27:29.737 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:29.736+0000 7f4f692bb700 0 -- 172.21.15.123:0/2552045281 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7f4f4c036440 msgr2=0x7f4f4c038870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:29.738 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:29.740 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:29.740 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.47 2023-12-06T15:27:29.845 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:29.845+0000 7fea91bac700 0 -- 172.21.15.123:0/3601124753 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x55f420eb3bc0 msgr2=0x55f420f6eef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T15:27:29.851 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:29.854 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:29.854 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.48 2023-12-06T15:27:29.941 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:29.943 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:29.944 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.49 2023-12-06T15:27:30.050 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:30.052 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:30.052 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.50 2023-12-06T15:27:30.135 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:30.135+0000 7f63a6290700 0 -- 172.21.15.123:0/3729394727 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7f6388036370 msgr2=0x7f63880387a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:30.139 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:30.141 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:30.141 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.51 2023-12-06T15:27:30.244 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:30.244+0000 7f704156f700 0 -- 172.21.15.123:0/880179768 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x555f9cd50500 msgr2=0x555f9cdf4fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:30.246 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:30.249 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:30.249 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.52 2023-12-06T15:27:30.331 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:30.331+0000 7f656a77a700 0 -- 172.21.15.123:0/2657313622 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7f654c036430 msgr2=0x7f654c038860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:30.334 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:30.339 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:30.339 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.53 2023-12-06T15:27:30.446 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:30.448 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:30.448 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.54 2023-12-06T15:27:30.543 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:30.546 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:30.546 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.55 2023-12-06T15:27:30.644 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:30.647 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:30.647 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.56 2023-12-06T15:27:30.742 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:30.744 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:30.744 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.57 2023-12-06T15:27:30.834 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:30.838 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:30.838 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.58 2023-12-06T15:27:30.936 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:30.939 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:30.939 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.59 2023-12-06T15:27:31.025 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:31.027 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:31.027 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.60 2023-12-06T15:27:31.140 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:31.139+0000 7fd01ca6a700 0 -- 172.21.15.123:0/1569906914 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7fcff8008780 msgr2=0x7fcff800abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:31.140 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:31.142 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:31.142 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.61 2023-12-06T15:27:31.232 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:31.231+0000 7f57cc841700 0 -- 172.21.15.123:0/2382792850 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7f57b0036440 msgr2=0x7f57b0038870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:31.233 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:31.236 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:31.236 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.62 2023-12-06T15:27:31.335 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:31.338 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:31.338 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.63 2023-12-06T15:27:31.435 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:31.437 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:31.438 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.64 2023-12-06T15:27:31.535 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:31.538 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:31.538 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.65 2023-12-06T15:27:31.633 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:31.636 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:31.636 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.66 2023-12-06T15:27:31.733 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:31.736 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:31.736 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.67 2023-12-06T15:27:31.838 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:31.837+0000 7f2c231c0700 0 -- 172.21.15.123:0/2448249746 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7f2c080363f0 msgr2=0x7f2c08038820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:31.845 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:31.849 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:31.849 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.68 2023-12-06T15:27:31.950 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:31.952 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:31.953 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.69 2023-12-06T15:27:32.056 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:32.058 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:32.059 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.70 2023-12-06T15:27:32.157 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:32.157+0000 7f06c4aca700 0 -- 172.21.15.123:0/252386699 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x5560abae8760 msgr2=0x5560abafce20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:32.162 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:32.165 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:32.165 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.71 2023-12-06T15:27:32.265 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:32.268 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:32.268 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.72 2023-12-06T15:27:32.359 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:32.362 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:32.362 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.73 2023-12-06T15:27:32.466 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:32.466+0000 7f9cb548d700 0 -- 172.21.15.123:0/3386718106 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7f9c98036440 msgr2=0x7f9c98038870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:32.472 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:32.475 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:32.475 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.74 2023-12-06T15:27:32.569 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:32.572 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:32.572 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.75 2023-12-06T15:27:32.660 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:32.663 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:32.663 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.76 2023-12-06T15:27:32.770 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:32.773 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:32.773 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.77 2023-12-06T15:27:32.871 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:32.874 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:32.874 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.78 2023-12-06T15:27:33.006 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:33.005+0000 7ffaf9688700 0 -- 172.21.15.123:0/1587416792 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7ffad4008780 msgr2=0x7ffad400abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:33.006 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:33.008 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:33.009 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.79 2023-12-06T15:27:33.114 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:33.117 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:33.117 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.80 2023-12-06T15:27:33.213 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:33.215 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:33.215 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.81 2023-12-06T15:27:33.318 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:33.317+0000 7fa747fd5700 0 -- 172.21.15.123:0/1346959280 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7fa728036510 msgr2=0x7fa728038940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:33.322 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:33.325 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:33.325 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.82 2023-12-06T15:27:33.441 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:33.443 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:33.443 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.83 2023-12-06T15:27:33.548 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:33.547+0000 7f4d19fec700 0 -- 172.21.15.123:0/1263019697 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x56202d961c80 msgr2=0x56202d962060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:33.548 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:33.550 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:33.551 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.84 2023-12-06T15:27:33.639 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:33.641 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:33.641 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.85 2023-12-06T15:27:33.756 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:33.758 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:33.759 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.86 2023-12-06T15:27:33.847 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:33.849 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:33.849 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.87 2023-12-06T15:27:33.944 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:33.947 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:33.947 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.88 2023-12-06T15:27:34.048 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:34.050 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:34.050 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.89 2023-12-06T15:27:34.154 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:34.157 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:34.157 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.90 2023-12-06T15:27:34.304 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:34.306 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:34.306 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.91 2023-12-06T15:27:34.397 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:34.396+0000 7f94005d2700 0 -- 172.21.15.123:0/3521968033 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7f93e4008780 msgr2=0x7f93e400abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:34.397 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:34.399 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:34.399 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.92 2023-12-06T15:27:34.506 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:34.508 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:34.508 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.93 2023-12-06T15:27:34.611 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:34.613 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:34.614 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.94 2023-12-06T15:27:34.751 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:34.755 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:34.755 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.95 2023-12-06T15:27:34.870 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:34.872 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:34.872 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.96 2023-12-06T15:27:34.974 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:34.977 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:34.977 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.97 2023-12-06T15:27:35.082 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:35.084 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:35.085 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.98 2023-12-06T15:27:35.188 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:35.191 INFO:tasks.workunit.client.0.smithi123.stderr:+ for i in $(seq -w 00 99) 2023-12-06T15:27:35.191 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm image.99 2023-12-06T15:27:35.289 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:35.291 INFO:tasks.workunit.client.0.smithi123.stderr:+ test_remove 2023-12-06T15:27:35.291 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 'testing remove...' 2023-12-06T15:27:35.292 INFO:tasks.workunit.client.0.smithi123.stdout:testing remove... 2023-12-06T15:27:35.292 INFO:tasks.workunit.client.0.smithi123.stderr:+ remove_images 2023-12-06T15:27:35.292 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:35.363 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:35.437 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:35.512 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:35.586 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:35.662 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:35.736 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:35.810 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:35.885 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:35.954 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:36.029 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:36.100 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:36.171 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:36.241 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:36.312 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:36.388 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:36.463 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:36.534 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:36.604 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd remove NOT_EXIST 2023-12-06T15:27:36.648 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 0% complete...failed. 2023-12-06T15:27:36.648 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: delete error: (2) No such file or directory 2023-12-06T15:27:36.650 INFO:tasks.workunit.client.0.smithi123.stderr:+ true 2023-12-06T15:27:36.650 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 1 -s 1 test1 2023-12-06T15:27:36.672 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: image format 1 is deprecated 2023-12-06T15:27:36.678 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:36.677+0000 7f0dbd4fa380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:36.684 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test1 2023-12-06T15:27:36.720 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:36.723 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:27:36.723 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:27:36.723 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^0$' 2023-12-06T15:27:36.748 INFO:tasks.workunit.client.0.smithi123.stdout:0 2023-12-06T15:27:36.748 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 -s 1 test2 2023-12-06T15:27:36.788 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test2 2023-12-06T15:27:36.884 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:36.887 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:27:36.887 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:27:36.887 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^0$' 2023-12-06T15:27:36.912 INFO:tasks.workunit.client.0.smithi123.stdout:0 2023-12-06T15:27:36.913 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 1 -s 1 test1 2023-12-06T15:27:36.934 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: image format 1 is deprecated 2023-12-06T15:27:36.940 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:36.939+0000 7fa8d688e380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:36.946 INFO:tasks.workunit.client.0.smithi123.stderr:+ rados rm -p rbd test1.rbd 2023-12-06T15:27:36.974 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test1 2023-12-06T15:27:37.003 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:37.005 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:27:37.005 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:27:37.005 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^0$' 2023-12-06T15:27:37.030 INFO:tasks.workunit.client.0.smithi123.stdout:0 2023-12-06T15:27:37.031 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 1 -eq 0 ']' 2023-12-06T15:27:37.031 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 -s 1 test2 2023-12-06T15:27:37.070 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create test2@snap 2023-12-06T15:27:37.295 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:27:37.306 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap protect test2@snap 2023-12-06T15:27:37.344 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd clone test2@snap clone --rbd-default-clone-format 1 2023-12-06T15:27:37.406 INFO:tasks.workunit.client.0.smithi123.stderr:+ rados -p rbd rm rbd_children 2023-12-06T15:27:37.444 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm clone 2023-12-06T15:27:37.560 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:37.559+0000 7ff3660ec700 0 -- 172.21.15.123:0/2831142054 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7ff340001550 msgr2=0x7ff340008c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:37.560 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:37.563 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:27:37.563 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep clone 2023-12-06T15:27:37.563 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:27:37.563 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^0$' 2023-12-06T15:27:37.588 INFO:tasks.workunit.client.0.smithi123.stdout:0 2023-12-06T15:27:37.588 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap unprotect test2@snap 2023-12-06T15:27:37.628 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap rm test2@snap 2023-12-06T15:27:38.357 INFO:tasks.workunit.client.0.smithi123.stderr: Removing snap: 100% complete...done. 2023-12-06T15:27:38.369 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test2 2023-12-06T15:27:38.483 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:38.483+0000 7fa3d50d3700 0 -- 172.21.15.123:0/2103331879 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7fa3b0008780 msgr2=0x7fa3b000abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:38.483 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:38.485 INFO:tasks.workunit.client.0.smithi123.stderr:+ test_migration 2023-12-06T15:27:38.486 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 'testing migration...' 2023-12-06T15:27:38.486 INFO:tasks.workunit.client.0.smithi123.stdout:testing migration... 2023-12-06T15:27:38.486 INFO:tasks.workunit.client.0.smithi123.stderr:+ remove_images 2023-12-06T15:27:38.486 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:38.557 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:38.627 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:38.699 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:38.772 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:38.847 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:38.922 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:38.996 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:39.069 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:39.144 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:39.217 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:39.289 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:39.374 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:39.448 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:39.521 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:39.594 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:39.666 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:39.737 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:27:39.808 INFO:tasks.workunit.client.0.smithi123.stderr:+ ceph osd pool create rbd2 8 2023-12-06T15:27:40.460 INFO:tasks.workunit.client.0.smithi123.stderr:pool 'rbd2' already exists 2023-12-06T15:27:40.469 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd pool init rbd2 2023-12-06T15:27:43.378 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 1 -s 128M test1 2023-12-06T15:27:43.403 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: image format 1 is deprecated 2023-12-06T15:27:43.410 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:43.410+0000 7f4585c94380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:43.417 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info test1 2023-12-06T15:27:43.417 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'format: 1' 2023-12-06T15:27:43.451 INFO:tasks.workunit.client.0.smithi123.stdout: format: 1 2023-12-06T15:27:43.451 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration prepare test1 --image-format 2 2023-12-06T15:27:43.519 INFO:tasks.workunit.client.0.smithi123.stderr:++ get_migration_state test1 2023-12-06T15:27:43.519 INFO:tasks.workunit.client.0.smithi123.stderr:++ local image=test1 2023-12-06T15:27:43.519 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd --format xml status test1 2023-12-06T15:27:43.519 INFO:tasks.workunit.client.0.smithi123.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-12-06T15:27:43.585 INFO:tasks.workunit.client.0.smithi123.stderr:+ test prepared = prepared 2023-12-06T15:27:43.585 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info test1 2023-12-06T15:27:43.585 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'format: 2' 2023-12-06T15:27:43.630 INFO:tasks.workunit.client.0.smithi123.stdout: format: 2 2023-12-06T15:27:43.633 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test1 2023-12-06T15:27:43.655 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:43.655+0000 7fe6447c7380 -1 librbd::image::PreRemoveRequest: 0x5588f9eca220 validate_image_removal: image in migration state - not removing 2023-12-06T15:27:43.656 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 0% complete...failed. 2023-12-06T15:27:43.656 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: error: image still has watchers 2023-12-06T15:27:43.656 INFO:tasks.workunit.client.0.smithi123.stderr:This means the image is still open or the client using it crashed. Try again after closing/unmapping it or waiting 30s for the crashed client to timeout. 2023-12-06T15:27:43.659 INFO:tasks.workunit.client.0.smithi123.stderr:+ true 2023-12-06T15:27:43.659 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration execute test1 2023-12-06T15:27:43.756 INFO:tasks.workunit.client.0.smithi123.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete...2023-12-06T15:27:43.756+0000 7fd17a41e700 0 -- 172.21.15.123:0/4022208316 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7fd15c036be0 msgr2=0x7fd15c039010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:43.777 INFO:tasks.workunit.client.0.smithi123.stderr: Image migration: 96% complete...2023-12-06T15:27:43.777+0000 7fd17a41e700 0 -- 172.21.15.123:0/4022208316 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x5565f1724560 msgr2=0x7fd15c03ba80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:43.797 INFO:tasks.workunit.client.0.smithi123.stderr: Image migration: 100% complete...done. 2023-12-06T15:27:43.800 INFO:tasks.workunit.client.0.smithi123.stderr:++ get_migration_state test1 2023-12-06T15:27:43.800 INFO:tasks.workunit.client.0.smithi123.stderr:++ local image=test1 2023-12-06T15:27:43.800 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd --format xml status test1 2023-12-06T15:27:43.800 INFO:tasks.workunit.client.0.smithi123.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-12-06T15:27:43.858 INFO:tasks.workunit.client.0.smithi123.stderr:+ test executed = executed 2023-12-06T15:27:43.858 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration commit test1 2023-12-06T15:27:43.945 INFO:tasks.workunit.client.0.smithi123.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete...2023-12-06T15:27:43.945+0000 7f11d4c78700 0 -- 172.21.15.123:0/2994196536 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7f11ac004bc0 msgr2=0x7f11ac006fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T15:27:43.958 INFO:tasks.workunit.client.0.smithi123.stderr: Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2023-12-06T15:27:43.959+0000 7f11d4c78700 0 -- 172.21.15.123:0/2994196536 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7f11b4036be0 msgr2=0x7f11b4039010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:43.970 INFO:tasks.workunit.client.0.smithi123.stderr: Commit image migration: 100% complete...done. 2023-12-06T15:27:43.972 INFO:tasks.workunit.client.0.smithi123.stderr:+ get_migration_state test1 2023-12-06T15:27:43.973 INFO:tasks.workunit.client.0.smithi123.stderr:+ local image=test1 2023-12-06T15:27:43.973 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd --format xml status test1 2023-12-06T15:27:43.973 INFO:tasks.workunit.client.0.smithi123.stderr:+ xmlstarlet sel -t -v //status/migration/state 2023-12-06T15:27:44.006 INFO:tasks.workunit.client.0.smithi123.stderr:+ true 2023-12-06T15:27:44.007 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info test1 2023-12-06T15:27:44.007 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'features: .*layering' 2023-12-06T15:27:44.039 INFO:tasks.workunit.client.0.smithi123.stderr:+ true 2023-12-06T15:27:44.039 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration prepare test1 --image-feature layering,exclusive-lock,object-map,fast-diff,deep-flatten 2023-12-06T15:27:44.138 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info test1 2023-12-06T15:27:44.139 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'features: .*layering' 2023-12-06T15:27:44.177 INFO:tasks.workunit.client.0.smithi123.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten, migrating 2023-12-06T15:27:44.177 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration execute test1 2023-12-06T15:27:44.255 INFO:tasks.workunit.client.0.smithi123.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-12-06T15:27:44.255+0000 7fbfea285700 0 -- 172.21.15.123:0/3124766544 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x55f256956780 msgr2=0x55f256a42940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:44.267 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:44.267+0000 7fbfea285700 0 -- 172.21.15.123:0/3124766544 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7fbfcc036be0 msgr2=0x7fbfcc039010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:44.269 INFO:tasks.workunit.client.0.smithi123.stderr: Image migration: 100% complete...done. 2023-12-06T15:27:44.272 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration commit test1 2023-12-06T15:27:44.350 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:44.351+0000 7f6a01eeb700 0 -- 172.21.15.123:0/2797923862 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x55aa449e8a00 msgr2=0x55aa44ad4ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:44.362 INFO:tasks.workunit.client.0.smithi123.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete...2023-12-06T15:27:44.363+0000 7f6a016ea700 0 -- 172.21.15.123:0/2797923862 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7f69e0004bc0 msgr2=0x7f69e0006fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:44.396 INFO:tasks.workunit.client.0.smithi123.stderr: Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete... Commit image migration: 100% complete...done. 2023-12-06T15:27:44.399 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration prepare test1 rbd2/test1 2023-12-06T15:27:44.500 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:44.500+0000 7f2a34e73700 0 -- 172.21.15.123:0/4198189100 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x55bcd171b0c0 msgr2=0x55bcd1777c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:44.503 INFO:tasks.workunit.client.0.smithi123.stderr:++ get_migration_state rbd2/test1 2023-12-06T15:27:44.504 INFO:tasks.workunit.client.0.smithi123.stderr:++ local image=rbd2/test1 2023-12-06T15:27:44.504 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd --format xml status rbd2/test1 2023-12-06T15:27:44.504 INFO:tasks.workunit.client.0.smithi123.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-12-06T15:27:44.575 INFO:tasks.workunit.client.0.smithi123.stderr:+ test prepared = prepared 2023-12-06T15:27:44.575 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:27:44.575 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:27:44.575 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^0$' 2023-12-06T15:27:44.600 INFO:tasks.workunit.client.0.smithi123.stdout:0 2023-12-06T15:27:44.600 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd -p rbd2 ls 2023-12-06T15:27:44.601 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep test1 2023-12-06T15:27:44.627 INFO:tasks.workunit.client.0.smithi123.stdout:test1 2023-12-06T15:27:44.628 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration execute test1 2023-12-06T15:27:44.712 INFO:tasks.workunit.client.0.smithi123.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-12-06T15:27:44.712+0000 7fddea48f700 0 -- 172.21.15.123:0/1122850113 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x56225c20b230 msgr2=0x56225c20d620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T15:27:44.721 INFO:tasks.workunit.client.0.smithi123.stderr: Image migration: 100% complete...done. 2023-12-06T15:27:44.725 INFO:tasks.workunit.client.0.smithi123.stderr:++ get_migration_state rbd2/test1 2023-12-06T15:27:44.725 INFO:tasks.workunit.client.0.smithi123.stderr:++ local image=rbd2/test1 2023-12-06T15:27:44.725 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd --format xml status rbd2/test1 2023-12-06T15:27:44.725 INFO:tasks.workunit.client.0.smithi123.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-12-06T15:27:44.787 INFO:tasks.workunit.client.0.smithi123.stderr:+ test executed = executed 2023-12-06T15:27:44.787 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm rbd2/test1 2023-12-06T15:27:44.825 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:44.825+0000 7f196166d700 -1 librbd::image::PreRemoveRequest: 0x5563a1a1b150 validate_image_removal: image in migration state - not removing 2023-12-06T15:27:44.833 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 0% complete...failed. 2023-12-06T15:27:44.833 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: error: image still has watchers 2023-12-06T15:27:44.833 INFO:tasks.workunit.client.0.smithi123.stderr:This means the image is still open or the client using it crashed. Try again after closing/unmapping it or waiting 30s for the crashed client to timeout. 2023-12-06T15:27:44.835 INFO:tasks.workunit.client.0.smithi123.stderr:+ true 2023-12-06T15:27:44.835 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration commit test1 2023-12-06T15:27:44.923 INFO:tasks.workunit.client.0.smithi123.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2023-12-06T15:27:44.924+0000 7f2d82bf0700 0 -- 172.21.15.123:0/3040789137 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x562fddacb9f0 msgr2=0x562fddbb9000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:44.935 INFO:tasks.workunit.client.0.smithi123.stderr: Commit image migration: 100% complete...done. 2023-12-06T15:27:44.938 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd namespace create rbd2/ns1 2023-12-06T15:27:44.967 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd namespace create rbd2/ns2 2023-12-06T15:27:44.996 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration prepare rbd2/test1 rbd2/ns1/test1 2023-12-06T15:27:45.077 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:45.077+0000 7fee9c6d6700 0 -- 172.21.15.123:0/2470638558 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7fee78008780 msgr2=0x7fee7800abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:45.083 INFO:tasks.workunit.client.0.smithi123.stderr:++ get_migration_state rbd2/ns1/test1 2023-12-06T15:27:45.083 INFO:tasks.workunit.client.0.smithi123.stderr:++ local image=rbd2/ns1/test1 2023-12-06T15:27:45.083 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd --format xml status rbd2/ns1/test1 2023-12-06T15:27:45.083 INFO:tasks.workunit.client.0.smithi123.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-12-06T15:27:45.153 INFO:tasks.workunit.client.0.smithi123.stderr:+ test prepared = prepared 2023-12-06T15:27:45.153 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration execute rbd2/test1 2023-12-06T15:27:45.213 INFO:tasks.workunit.client.0.smithi123.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-12-06T15:27:45.214+0000 7f0896148700 0 -- 172.21.15.123:0/2463497983 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x5609f0b4f1d0 msgr2=0x5609f0c4aa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:45.215 INFO:tasks.workunit.client.0.smithi123.stderr: Image migration: 100% complete...done. 2023-12-06T15:27:45.219 INFO:tasks.workunit.client.0.smithi123.stderr:++ get_migration_state rbd2/ns1/test1 2023-12-06T15:27:45.219 INFO:tasks.workunit.client.0.smithi123.stderr:++ local image=rbd2/ns1/test1 2023-12-06T15:27:45.219 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd --format xml status rbd2/ns1/test1 2023-12-06T15:27:45.219 INFO:tasks.workunit.client.0.smithi123.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-12-06T15:27:45.278 INFO:tasks.workunit.client.0.smithi123.stderr:+ test executed = executed 2023-12-06T15:27:45.278 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration commit rbd2/test1 2023-12-06T15:27:45.358 INFO:tasks.workunit.client.0.smithi123.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2023-12-06T15:27:45.358+0000 7f514bc3c700 0 -- 172.21.15.123:0/255664539 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7f5130036be0 msgr2=0x7f5130039010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:45.379 INFO:tasks.workunit.client.0.smithi123.stderr: Commit image migration: 100% complete...done. 2023-12-06T15:27:45.382 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration prepare rbd2/ns1/test1 rbd2/ns2/test1 2023-12-06T15:27:45.475 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:45.475+0000 7f52a4870700 0 -- 172.21.15.123:0/80421902 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x555f0f7aebd0 msgr2=0x555f0f7b0fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:45.481 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration execute rbd2/ns2/test1 2023-12-06T15:27:45.542 INFO:tasks.workunit.client.0.smithi123.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-12-06T15:27:45.542+0000 7f833a8e1700 0 -- 172.21.15.123:0/2275412187 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x556620be3780 msgr2=0x556620c8a2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:45.550 INFO:tasks.workunit.client.0.smithi123.stderr: Image migration: 100% complete...done. 2023-12-06T15:27:45.553 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration commit rbd2/ns2/test1 2023-12-06T15:27:45.624 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:45.625+0000 7f830ffa7700 0 -- 172.21.15.123:0/1323893001 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x561c63a6e7e0 msgr2=0x561c63b14290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:45.637 INFO:tasks.workunit.client.0.smithi123.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2023-12-06T15:27:45.636+0000 7f830ffa7700 0 -- 172.21.15.123:0/1323893001 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7f82f0036be0 msgr2=0x7f82f0039010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:45.654 INFO:tasks.workunit.client.0.smithi123.stderr: Commit image migration: 100% complete...done. 2023-12-06T15:27:45.657 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create -s 128M test1 2023-12-06T15:27:45.685 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:45.683+0000 7f6f96ab3380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:45.689 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration prepare test1 --data-pool rbd2 2023-12-06T15:27:45.762 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info test1 2023-12-06T15:27:45.762 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'data_pool: rbd2' 2023-12-06T15:27:45.798 INFO:tasks.workunit.client.0.smithi123.stdout: data_pool: rbd2 2023-12-06T15:27:45.798 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration execute test1 2023-12-06T15:27:45.879 INFO:tasks.workunit.client.0.smithi123.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-12-06T15:27:45.879+0000 7f13d9eaa700 0 -- 172.21.15.123:0/3839013548 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x55ec5859f560 msgr2=0x55ec5868ca40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:45.899 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:45.899+0000 7f13d96a9700 0 -- 172.21.15.123:0/3839013548 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7f13b4008780 msgr2=0x7f13b400abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:45.901 INFO:tasks.workunit.client.0.smithi123.stderr: Image migration: 100% complete...done. 2023-12-06T15:27:45.903 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration commit test1 2023-12-06T15:27:45.985 INFO:tasks.workunit.client.0.smithi123.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete...2023-12-06T15:27:45.986+0000 7fdbda12f700 0 -- 172.21.15.123:0/1079586742 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x5583664c87e0 msgr2=0x5583665b4da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T15:27:45.995 INFO:tasks.workunit.client.0.smithi123.stderr: Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2023-12-06T15:27:45.996+0000 7fdbd992e700 0 -- 172.21.15.123:0/1079586742 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7fdbb8008780 msgr2=0x7fdbb800abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:46.009 INFO:tasks.workunit.client.0.smithi123.stderr: Commit image migration: 100% complete...done. 2023-12-06T15:27:46.012 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration prepare test1 2023-12-06T15:27:46.101 INFO:tasks.workunit.client.0.smithi123.stderr:+ expect_fail rbd trash mv test1 2023-12-06T15:27:46.101 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv test1 2023-12-06T15:27:46.134 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:46.134+0000 7f10dc3f5380 -1 librbd::api::Trash: move: cannot move migrating image to trash 2023-12-06T15:27:46.139 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: deferred delete error: (16) Device or resource busy 2023-12-06T15:27:46.141 INFO:tasks.workunit.client.0.smithi123.stderr:+ return 0 2023-12-06T15:27:46.142 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd trash ls -a 2023-12-06T15:27:46.142 INFO:tasks.workunit.client.0.smithi123.stderr:++ cut -d ' ' -f 1 2023-12-06T15:27:46.169 INFO:tasks.workunit.client.0.smithi123.stderr:+ ID=19df5dddbf98 2023-12-06T15:27:46.169 INFO:tasks.workunit.client.0.smithi123.stderr:+ expect_fail rbd trash rm 19df5dddbf98 2023-12-06T15:27:46.169 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash rm 19df5dddbf98 2023-12-06T15:27:46.200 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:46.200+0000 7f61b9648700 -1 librbd::image::RefreshRequest: image being migrated 2023-12-06T15:27:46.200 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:46.200+0000 7f61b9648700 -1 librbd::image::OpenRequest: failed to refresh image: (30) Read-only file system 2023-12-06T15:27:46.200 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:46.200+0000 7f61b9648700 -1 librbd::ImageState: 0x7f619c048b60 failed to open image: (30) Read-only file system 2023-12-06T15:27:46.201 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:46.200+0000 7f61977fe700 -1 librbd::image::RemoveRequest: 0x7f619c000b80 handle_open_image: error opening image: (30) Read-only file system 2023-12-06T15:27:46.202 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: remove error: (30) Read-only file system 2023-12-06T15:27:46.202 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 0% complete...failed. 2023-12-06T15:27:46.204 INFO:tasks.workunit.client.0.smithi123.stderr:+ return 0 2023-12-06T15:27:46.204 INFO:tasks.workunit.client.0.smithi123.stderr:+ expect_fail rbd trash restore 19df5dddbf98 2023-12-06T15:27:46.204 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash restore 19df5dddbf98 2023-12-06T15:27:46.229 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: restore error: 2023-12-06T15:27:46.229+0000 7f94dbf16380 -1 librbd::api::Trash: restore: Current trash source 'migration' does not match expected: user,mirroring,unknown (4) 2023-12-06T15:27:46.229 INFO:tasks.workunit.client.0.smithi123.stderr:(22) Invalid argument 2023-12-06T15:27:46.231 INFO:tasks.workunit.client.0.smithi123.stderr:+ return 0 2023-12-06T15:27:46.231 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration abort test1 2023-12-06T15:27:46.302 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:27:46.302+0000 7f29c9aa4700 -1 reset not still connected to 0x5612a4a97c70 2023-12-06T15:27:46.325 INFO:tasks.workunit.client.0.smithi123.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-12-06T15:27:46.325+0000 7f7e1265e700 0 -- 172.21.15.123:0/4144011676 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x556a8da9ad50 msgr2=0x556a8db87dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:46.341 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:46.342+0000 7f7e1265e700 0 -- 172.21.15.123:0/4144011676 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7f7df8008780 msgr2=0x7f7df403c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T15:27:46.350 INFO:tasks.workunit.client.0.smithi123.stderr: Abort image migration: 100% complete...done. 2023-12-06T15:27:46.353 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd remove test1 2023-12-06T15:27:46.442 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-12-06T15:27:46.445 INFO:tasks.workunit.client.0.smithi123.stderr:+ dd if=/dev/urandom bs=1M count=1 2023-12-06T15:27:46.445 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd --image-format 2 import - test1 2023-12-06T15:27:46.493 INFO:tasks.workunit.client.0.smithi123.stderr:1+0 records in 2023-12-06T15:27:46.493 INFO:tasks.workunit.client.0.smithi123.stderr:1+0 records out 2023-12-06T15:27:46.493 INFO:tasks.workunit.client.0.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0474757 s, 22.1 MB/s 2023-12-06T15:27:46.523 INFO:tasks.workunit.client.0.smithi123.stderr: Importing image: 100% complete...done. 2023-12-06T15:27:46.526 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd export test1 - 2023-12-06T15:27:46.526 INFO:tasks.workunit.client.0.smithi123.stderr:++ md5sum 2023-12-06T15:27:46.559 INFO:tasks.workunit.client.0.smithi123.stderr: Exporting image: 100% complete...done. 2023-12-06T15:27:46.562 INFO:tasks.workunit.client.0.smithi123.stderr:+ md5sum='cc25e3bcaa14bb4320786c1006b3bd18 -' 2023-12-06T15:27:46.562 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create test1@snap1 2023-12-06T15:27:47.398 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:27:47.407 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap protect test1@snap1 2023-12-06T15:27:47.449 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create test1@snap2 2023-12-06T15:27:48.220 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:27:48.229 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd clone test1@snap1 clone_v1 --rbd_default_clone_format=1 2023-12-06T15:27:48.313 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd clone test1@snap2 clone_v2 --rbd_default_clone_format=2 2023-12-06T15:27:48.385 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info clone_v1 2023-12-06T15:27:48.386 INFO:tasks.workunit.client.0.smithi123.stderr:+ fgrep 'parent: rbd/test1@snap1' 2023-12-06T15:27:48.424 INFO:tasks.workunit.client.0.smithi123.stdout: parent: rbd/test1@snap1 2023-12-06T15:27:48.424 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info clone_v2 2023-12-06T15:27:48.424 INFO:tasks.workunit.client.0.smithi123.stderr:+ fgrep 'parent: rbd/test1@snap2' 2023-12-06T15:27:48.463 INFO:tasks.workunit.client.0.smithi123.stdout: parent: rbd/test1@snap2 2023-12-06T15:27:48.463 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info clone_v2 2023-12-06T15:27:48.463 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'op_features: clone-child' 2023-12-06T15:27:48.501 INFO:tasks.workunit.client.0.smithi123.stdout: op_features: clone-child 2023-12-06T15:27:48.502 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd export clone_v1 - 2023-12-06T15:27:48.502 INFO:tasks.workunit.client.0.smithi123.stderr:++ md5sum 2023-12-06T15:27:48.541 INFO:tasks.workunit.client.0.smithi123.stderr: Exporting image: 100% complete...done. 2023-12-06T15:27:48.545 INFO:tasks.workunit.client.0.smithi123.stderr:+ test 'cc25e3bcaa14bb4320786c1006b3bd18 -' = 'cc25e3bcaa14bb4320786c1006b3bd18 -' 2023-12-06T15:27:48.545 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd export clone_v2 - 2023-12-06T15:27:48.545 INFO:tasks.workunit.client.0.smithi123.stderr:++ md5sum 2023-12-06T15:27:48.583 INFO:tasks.workunit.client.0.smithi123.stderr: Exporting image: 100% complete...done. 2023-12-06T15:27:48.587 INFO:tasks.workunit.client.0.smithi123.stderr:+ test 'cc25e3bcaa14bb4320786c1006b3bd18 -' = 'cc25e3bcaa14bb4320786c1006b3bd18 -' 2023-12-06T15:27:48.587 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd children test1@snap1 2023-12-06T15:27:48.626 INFO:tasks.workunit.client.0.smithi123.stderr:+ test rbd/clone_v1 = rbd/clone_v1 2023-12-06T15:27:48.626 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd children test1@snap2 2023-12-06T15:27:48.661 INFO:tasks.workunit.client.0.smithi123.stderr:+ test rbd/clone_v2 = rbd/clone_v2 2023-12-06T15:27:48.661 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration prepare test1 rbd2/test2 2023-12-06T15:27:48.739 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:48.739+0000 7f47ba15e700 0 -- 172.21.15.123:0/673016740 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7f479c036b50 msgr2=0x7f479c038f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T15:27:50.395 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:50.396+0000 7f47ba15e700 0 -- 172.21.15.123:0/673016740 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7f47a0008780 msgr2=0x7f479c03bd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T15:27:50.472 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info clone_v1 2023-12-06T15:27:50.473 INFO:tasks.workunit.client.0.smithi123.stderr:+ fgrep 'parent: rbd2/test2@snap1' 2023-12-06T15:27:50.528 INFO:tasks.workunit.client.0.smithi123.stdout: parent: rbd2/test2@snap1 2023-12-06T15:27:50.528 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info clone_v2 2023-12-06T15:27:50.529 INFO:tasks.workunit.client.0.smithi123.stderr:+ fgrep 'parent: rbd2/test2@snap2' 2023-12-06T15:27:50.580 INFO:tasks.workunit.client.0.smithi123.stdout: parent: rbd2/test2@snap2 2023-12-06T15:27:50.581 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info clone_v2 2023-12-06T15:27:50.581 INFO:tasks.workunit.client.0.smithi123.stderr:+ fgrep 'op_features: clone-child' 2023-12-06T15:27:50.632 INFO:tasks.workunit.client.0.smithi123.stdout: op_features: clone-child 2023-12-06T15:27:50.633 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd children rbd2/test2@snap1 2023-12-06T15:27:50.684 INFO:tasks.workunit.client.0.smithi123.stderr:+ test rbd/clone_v1 = rbd/clone_v1 2023-12-06T15:27:50.684 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd children rbd2/test2@snap2 2023-12-06T15:27:50.730 INFO:tasks.workunit.client.0.smithi123.stderr:+ test rbd/clone_v2 = rbd/clone_v2 2023-12-06T15:27:50.730 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration execute test1 2023-12-06T15:27:50.827 INFO:tasks.workunit.client.0.smithi123.stderr: Image migration: 100% complete...done. 2023-12-06T15:27:50.830 INFO:tasks.workunit.client.0.smithi123.stderr:+ expect_fail rbd migration commit test1 2023-12-06T15:27:50.830 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration commit test1 2023-12-06T15:27:50.892 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: the image has descendants: 2023-12-06T15:27:50.892 INFO:tasks.workunit.client.0.smithi123.stderr: rbd/clone_v1 2023-12-06T15:27:50.892 INFO:tasks.workunit.client.0.smithi123.stderr: rbd/clone_v2 2023-12-06T15:27:50.892 INFO:tasks.workunit.client.0.smithi123.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2023-12-06T15:27:50.893 INFO:tasks.workunit.client.0.smithi123.stderr:Ensure no descendant images are opened read-only and run again with force flag. 2023-12-06T15:27:50.895 INFO:tasks.workunit.client.0.smithi123.stderr:+ return 0 2023-12-06T15:27:50.895 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration commit test1 --force 2023-12-06T15:27:50.960 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: the image has descendants: 2023-12-06T15:27:50.960 INFO:tasks.workunit.client.0.smithi123.stderr: rbd/clone_v1 2023-12-06T15:27:50.960 INFO:tasks.workunit.client.0.smithi123.stderr: rbd/clone_v2 2023-12-06T15:27:50.960 INFO:tasks.workunit.client.0.smithi123.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2023-12-06T15:27:50.960 INFO:tasks.workunit.client.0.smithi123.stderr:Proceeding anyway due to force flag set. 2023-12-06T15:27:50.969 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:50.969+0000 7f7c3eb29700 0 -- 172.21.15.123:0/190133852 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7f7c24036990 msgr2=0x7f7c24038dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T15:27:50.977 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:50.977+0000 7f7c3eb29700 0 -- 172.21.15.123:0/190133852 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x561f0df5d500 msgr2=0x7f7c240393e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:52.441 INFO:tasks.workunit.client.0.smithi123.stderr: Commit image migration: 100% complete...done. 2023-12-06T15:27:52.445 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd export clone_v1 - 2023-12-06T15:27:52.445 INFO:tasks.workunit.client.0.smithi123.stderr:++ md5sum 2023-12-06T15:27:52.488 INFO:tasks.workunit.client.0.smithi123.stderr: Exporting image: 100% complete...done. 2023-12-06T15:27:52.492 INFO:tasks.workunit.client.0.smithi123.stderr:+ test 'cc25e3bcaa14bb4320786c1006b3bd18 -' = 'cc25e3bcaa14bb4320786c1006b3bd18 -' 2023-12-06T15:27:52.492 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd export clone_v2 - 2023-12-06T15:27:52.492 INFO:tasks.workunit.client.0.smithi123.stderr:++ md5sum 2023-12-06T15:27:52.734 INFO:tasks.workunit.client.0.smithi123.stderr: Exporting image: 100% complete...done. 2023-12-06T15:27:52.737 INFO:tasks.workunit.client.0.smithi123.stderr:+ test 'cc25e3bcaa14bb4320786c1006b3bd18 -' = 'cc25e3bcaa14bb4320786c1006b3bd18 -' 2023-12-06T15:27:52.738 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration prepare rbd2/test2 test1 2023-12-06T15:27:52.839 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:52.840+0000 7f4b65beb700 0 -- 172.21.15.123:0/400403164 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x555661cf93c0 msgr2=0x555661d53d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T15:27:54.217 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:54.217+0000 7f4b653ea700 0 -- 172.21.15.123:0/400403164 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7f4b40008780 msgr2=0x7f4b4000abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:54.287 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info clone_v1 2023-12-06T15:27:54.287 INFO:tasks.workunit.client.0.smithi123.stderr:+ fgrep 'parent: rbd/test1@snap1' 2023-12-06T15:27:54.341 INFO:tasks.workunit.client.0.smithi123.stdout: parent: rbd/test1@snap1 2023-12-06T15:27:54.341 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info clone_v2 2023-12-06T15:27:54.341 INFO:tasks.workunit.client.0.smithi123.stderr:+ fgrep 'parent: rbd/test1@snap2' 2023-12-06T15:27:54.396 INFO:tasks.workunit.client.0.smithi123.stdout: parent: rbd/test1@snap2 2023-12-06T15:27:54.396 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info clone_v2 2023-12-06T15:27:54.396 INFO:tasks.workunit.client.0.smithi123.stderr:+ fgrep 'op_features: clone-child' 2023-12-06T15:27:54.447 INFO:tasks.workunit.client.0.smithi123.stdout: op_features: clone-child 2023-12-06T15:27:54.448 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd children test1@snap1 2023-12-06T15:27:54.499 INFO:tasks.workunit.client.0.smithi123.stderr:+ test rbd/clone_v1 = rbd/clone_v1 2023-12-06T15:27:54.499 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd children test1@snap2 2023-12-06T15:27:54.547 INFO:tasks.workunit.client.0.smithi123.stderr:+ test rbd/clone_v2 = rbd/clone_v2 2023-12-06T15:27:54.547 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration execute test1 2023-12-06T15:27:54.645 INFO:tasks.workunit.client.0.smithi123.stderr: Image migration: 100% complete...done. 2023-12-06T15:27:54.648 INFO:tasks.workunit.client.0.smithi123.stderr:+ expect_fail rbd migration commit test1 2023-12-06T15:27:54.648 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration commit test1 2023-12-06T15:27:54.717 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: the image has descendants: 2023-12-06T15:27:54.717 INFO:tasks.workunit.client.0.smithi123.stderr: rbd/clone_v1 2023-12-06T15:27:54.717 INFO:tasks.workunit.client.0.smithi123.stderr: rbd/clone_v2 2023-12-06T15:27:54.717 INFO:tasks.workunit.client.0.smithi123.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2023-12-06T15:27:54.717 INFO:tasks.workunit.client.0.smithi123.stderr:Ensure no descendant images are opened read-only and run again with force flag. 2023-12-06T15:27:54.720 INFO:tasks.workunit.client.0.smithi123.stderr:+ return 0 2023-12-06T15:27:54.720 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration commit test1 --force 2023-12-06T15:27:54.791 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: the image has descendants: 2023-12-06T15:27:54.791 INFO:tasks.workunit.client.0.smithi123.stderr: rbd/clone_v1 2023-12-06T15:27:54.791 INFO:tasks.workunit.client.0.smithi123.stderr: rbd/clone_v2 2023-12-06T15:27:54.791 INFO:tasks.workunit.client.0.smithi123.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2023-12-06T15:27:54.791 INFO:tasks.workunit.client.0.smithi123.stderr:Proceeding anyway due to force flag set. 2023-12-06T15:27:54.795 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:54.795+0000 7f9ee347f700 0 -- 172.21.15.123:0/641562897 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x55c48bf17a70 msgr2=0x55c48bf711c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:54.806 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:54.806+0000 7f9ee347f700 0 -- 172.21.15.123:0/641562897 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7f9ec8036ae0 msgr2=0x7f9ec8038f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:56.254 INFO:tasks.workunit.client.0.smithi123.stderr: Commit image migration: 100% complete...done. 2023-12-06T15:27:56.258 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd export clone_v1 - 2023-12-06T15:27:56.258 INFO:tasks.workunit.client.0.smithi123.stderr:++ md5sum 2023-12-06T15:27:56.303 INFO:tasks.workunit.client.0.smithi123.stderr: Exporting image: 100% complete...done. 2023-12-06T15:27:56.306 INFO:tasks.workunit.client.0.smithi123.stderr:+ test 'cc25e3bcaa14bb4320786c1006b3bd18 -' = 'cc25e3bcaa14bb4320786c1006b3bd18 -' 2023-12-06T15:27:56.307 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd export clone_v2 - 2023-12-06T15:27:56.307 INFO:tasks.workunit.client.0.smithi123.stderr:++ md5sum 2023-12-06T15:27:56.347 INFO:tasks.workunit.client.0.smithi123.stderr: Exporting image: 100% complete...done. 2023-12-06T15:27:56.350 INFO:tasks.workunit.client.0.smithi123.stderr:+ test 'cc25e3bcaa14bb4320786c1006b3bd18 -' = 'cc25e3bcaa14bb4320786c1006b3bd18 -' 2023-12-06T15:27:56.350 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd remove clone_v1 2023-12-06T15:27:56.465 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:56.465+0000 7f28a90d8700 0 -- 172.21.15.123:0/4061461627 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7f2884008780 msgr2=0x7f288400abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:56.465 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:56.467 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd remove clone_v2 2023-12-06T15:27:56.566 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:56.566+0000 7f3497a53700 0 -- 172.21.15.123:0/2977054640 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x557e5bba34e0 msgr2=0x557e5bc484a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:56.572 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:56.574 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap unprotect test1@snap1 2023-12-06T15:27:56.615 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap purge test1 2023-12-06T15:27:58.214 INFO:tasks.workunit.client.0.smithi123.stderr: Removing all snapshots: 50% complete... Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-12-06T15:27:58.227 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test1 2023-12-06T15:27:58.350 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:58.350+0000 7f005996a700 0 -- 172.21.15.123:0/1872674011 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x55b7af7474e0 msgr2=0x55b7af7ed1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:58.352 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:27:58.355 INFO:tasks.workunit.client.0.smithi123.stderr:+ for format in 1 2 2023-12-06T15:27:58.355 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create -s 128M --image-format 1 test2 2023-12-06T15:27:58.379 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: image format 1 is deprecated 2023-12-06T15:27:58.384 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:58.385+0000 7f725f093380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:58.395 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration prepare test2 --data-pool rbd2 2023-12-06T15:27:58.462 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-12-06T15:27:58.503 INFO:tasks.workunit.client.0.smithi123.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T15:27:58.506 INFO:tasks.workunit.client.0.smithi123.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T15:27:58.506 INFO:tasks.workunit.client.0.smithi123.stdout:elapsed: 0 ops: 1 ops/sec: 333.341 bytes/sec: 333 KiB/s 2023-12-06T15:27:58.510 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration abort test2 2023-12-06T15:27:58.597 INFO:tasks.workunit.client.0.smithi123.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-12-06T15:27:58.597+0000 7f267c98c700 0 -- 172.21.15.123:0/2071306277 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x5590de756560 msgr2=0x5590de842aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:58.628 INFO:tasks.workunit.client.0.smithi123.stderr: Abort image migration: 100% complete...done. 2023-12-06T15:27:58.630 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-12-06T15:27:58.666 INFO:tasks.workunit.client.0.smithi123.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T15:27:58.669 INFO:tasks.workunit.client.0.smithi123.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T15:27:58.670 INFO:tasks.workunit.client.0.smithi123.stdout:elapsed: 0 ops: 1 ops/sec: 250.006 bytes/sec: 250 KiB/s 2023-12-06T15:27:58.673 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test2 2023-12-06T15:27:58.731 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-12-06T15:27:58.733 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create -s 128M --image-format 1 test2 2023-12-06T15:27:58.755 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: image format 1 is deprecated 2023-12-06T15:27:58.761 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:58.761+0000 7f0e3f02e380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:58.767 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration prepare test2 --data-pool rbd2 2023-12-06T15:27:58.835 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-12-06T15:27:58.874 INFO:tasks.workunit.client.0.smithi123.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T15:27:58.878 INFO:tasks.workunit.client.0.smithi123.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T15:27:58.878 INFO:tasks.workunit.client.0.smithi123.stdout:elapsed: 0 ops: 1 ops/sec: 333.341 bytes/sec: 333 KiB/s 2023-12-06T15:27:58.882 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration execute test2 2023-12-06T15:27:58.966 INFO:tasks.workunit.client.0.smithi123.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-12-06T15:27:58.967+0000 7ff87b9d4700 0 -- 172.21.15.123:0/3833120489 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7ff860073720 msgr2=0x7ff860075b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:58.989 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:58.990+0000 7ff87c1d5700 0 -- 172.21.15.123:0/3833120489 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7ff85c036d80 msgr2=0x7ff85c0391b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:59.003 INFO:tasks.workunit.client.0.smithi123.stderr: Image migration: 100% complete...done. 2023-12-06T15:27:59.005 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration abort test2 2023-12-06T15:27:59.079 INFO:tasks.workunit.client.0.smithi123.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-12-06T15:27:59.079+0000 7fc4a6e9f700 0 -- 172.21.15.123:0/3753989157 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x558f9477e560 msgr2=0x558f9486ad80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T15:27:59.091 INFO:tasks.workunit.client.0.smithi123.stderr: Abort image migration: 100% complete...done. 2023-12-06T15:27:59.093 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-12-06T15:27:59.128 INFO:tasks.workunit.client.0.smithi123.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T15:27:59.131 INFO:tasks.workunit.client.0.smithi123.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T15:27:59.131 INFO:tasks.workunit.client.0.smithi123.stdout:elapsed: 0 ops: 1 ops/sec: 500.012 bytes/sec: 500 KiB/s 2023-12-06T15:27:59.135 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test2 2023-12-06T15:27:59.188 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-12-06T15:27:59.191 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create -s 128M --image-format 1 test2 2023-12-06T15:27:59.213 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: image format 1 is deprecated 2023-12-06T15:27:59.219 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:59.219+0000 7f8ec9d28380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:59.225 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration prepare test2 --data-pool INVALID_DATA_POOL 2023-12-06T15:27:59.271 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:59.271+0000 7fb613819380 -1 librbd::image::CreateRequest: 0x55d30ed2b690 validate_data_pool: data pool INVALID_DATA_POOL does not exist 2023-12-06T15:27:59.271 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:59.271+0000 7fb613819380 -1 librbd::Migration: create_dst_image: header creation failed: (2) No such file or directory 2023-12-06T15:27:59.286 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: preparing migration failed: (2) No such file or directory 2023-12-06T15:27:59.288 INFO:tasks.workunit.client.0.smithi123.stderr:+ true 2023-12-06T15:27:59.288 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-12-06T15:27:59.320 INFO:tasks.workunit.client.0.smithi123.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T15:27:59.322 INFO:tasks.workunit.client.0.smithi123.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T15:27:59.322 INFO:tasks.workunit.client.0.smithi123.stdout:elapsed: 0 ops: 1 ops/sec: 333.341 bytes/sec: 333 KiB/s 2023-12-06T15:27:59.327 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test2 2023-12-06T15:27:59.389 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-12-06T15:27:59.392 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create -s 128M --image-format 1 test2 2023-12-06T15:27:59.414 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: image format 1 is deprecated 2023-12-06T15:27:59.420 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:59.419+0000 7f583e494380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:59.429 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration prepare test2 rbd2/test2 2023-12-06T15:27:59.500 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 rbd2/test2 2023-12-06T15:27:59.540 INFO:tasks.workunit.client.0.smithi123.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T15:27:59.547 INFO:tasks.workunit.client.0.smithi123.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T15:27:59.547 INFO:tasks.workunit.client.0.smithi123.stdout:elapsed: 0 ops: 1 ops/sec: 125.003 bytes/sec: 125 KiB/s 2023-12-06T15:27:59.553 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration abort test2 2023-12-06T15:27:59.625 INFO:tasks.workunit.client.0.smithi123.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete... Abort image migration: 100% complete...done. 2023-12-06T15:27:59.628 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-12-06T15:27:59.662 INFO:tasks.workunit.client.0.smithi123.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T15:27:59.665 INFO:tasks.workunit.client.0.smithi123.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T15:27:59.665 INFO:tasks.workunit.client.0.smithi123.stdout:elapsed: 0 ops: 1 ops/sec: 333.341 bytes/sec: 333 KiB/s 2023-12-06T15:27:59.669 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test2 2023-12-06T15:27:59.724 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-12-06T15:27:59.726 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create -s 128M --image-format 1 test2 2023-12-06T15:27:59.749 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: image format 1 is deprecated 2023-12-06T15:27:59.754 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:27:59.755+0000 7f42aee39380 -1 librbd: Forced V1 image creation. 2023-12-06T15:27:59.761 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration prepare test2 rbd2/test2 2023-12-06T15:27:59.826 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration abort rbd2/test2 2023-12-06T15:27:59.901 INFO:tasks.workunit.client.0.smithi123.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-12-06T15:27:59.901+0000 7f0c5df09700 0 -- 172.21.15.123:0/1194578734 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7f0c38004bc0 msgr2=0x7f0c38006fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:27:59.908 INFO:tasks.workunit.client.0.smithi123.stderr: Abort image migration: 100% complete...done. 2023-12-06T15:27:59.911 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-12-06T15:27:59.948 INFO:tasks.workunit.client.0.smithi123.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T15:27:59.952 INFO:tasks.workunit.client.0.smithi123.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T15:27:59.952 INFO:tasks.workunit.client.0.smithi123.stdout:elapsed: 0 ops: 1 ops/sec: 250.006 bytes/sec: 250 KiB/s 2023-12-06T15:27:59.957 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test2 2023-12-06T15:28:00.007 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-12-06T15:28:00.010 INFO:tasks.workunit.client.0.smithi123.stderr:+ test 1 = 1 2023-12-06T15:28:00.010 INFO:tasks.workunit.client.0.smithi123.stderr:+ continue 2023-12-06T15:28:00.010 INFO:tasks.workunit.client.0.smithi123.stderr:+ for format in 1 2 2023-12-06T15:28:00.010 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create -s 128M --image-format 2 test2 2023-12-06T15:28:00.051 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration prepare test2 --data-pool rbd2 2023-12-06T15:28:00.161 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:28:00.162+0000 7fb044e35700 0 -- 172.21.15.123:0/3025942033 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x5627c5463160 msgr2=0x5627c54bfc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:28:00.164 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-12-06T15:28:00.211 INFO:tasks.workunit.client.0.smithi123.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T15:28:00.220 INFO:tasks.workunit.client.0.smithi123.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T15:28:00.220 INFO:tasks.workunit.client.0.smithi123.stdout:elapsed: 0 ops: 1 ops/sec: 111.114 bytes/sec: 111 KiB/s 2023-12-06T15:28:00.224 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:28:00.224+0000 7f64ab87c700 0 -- 172.21.15.123:0/4000807880 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x55aaab5d1240 msgr2=0x55aaab62dad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:28:00.234 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration abort test2 2023-12-06T15:28:00.351 INFO:tasks.workunit.client.0.smithi123.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-12-06T15:28:00.351+0000 7f822cb0a700 0 -- 172.21.15.123:0/4081106082 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x5614af28ff70 msgr2=0x5614af37caa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:28:00.352 INFO:tasks.workunit.client.0.smithi123.stderr: Abort image migration: 100% complete...done. 2023-12-06T15:28:00.354 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-12-06T15:28:00.395 INFO:tasks.workunit.client.0.smithi123.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T15:28:00.397 INFO:tasks.workunit.client.0.smithi123.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T15:28:00.397 INFO:tasks.workunit.client.0.smithi123.stdout:elapsed: 0 ops: 1 ops/sec: 333.341 bytes/sec: 333 KiB/s 2023-12-06T15:28:00.403 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:28:00.403+0000 7f0465a9b700 0 -- 172.21.15.123:0/777323506 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x55cc86735120 msgr2=0x55cc8678e630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:28:00.406 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test2 2023-12-06T15:28:00.531 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-12-06T15:28:00.530+0000 7f514a866700 0 -- 172.21.15.123:0/3011304478 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7f512c036d80 msgr2=0x7f512c0391b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:28:00.549 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:28:00.551 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create -s 128M --image-format 2 test2 2023-12-06T15:28:00.595 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration prepare test2 --data-pool rbd2 2023-12-06T15:28:00.690 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:28:00.690+0000 7f1d199cb700 0 -- 172.21.15.123:0/3658990310 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7f1d00008780 msgr2=0x7f1d0000abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:28:00.693 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-12-06T15:28:00.740 INFO:tasks.workunit.client.0.smithi123.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T15:28:00.745 INFO:tasks.workunit.client.0.smithi123.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T15:28:00.745 INFO:tasks.workunit.client.0.smithi123.stdout:elapsed: 0 ops: 1 ops/sec: 166.671 bytes/sec: 167 KiB/s 2023-12-06T15:28:00.754 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:28:00.754+0000 7f81192b2700 0 -- 172.21.15.123:0/741174558 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7f80f4008780 msgr2=0x7f80f400abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:28:00.759 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration execute test2 2023-12-06T15:28:00.853 INFO:tasks.workunit.client.0.smithi123.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-12-06T15:28:00.853+0000 7f47b0534700 0 -- 172.21.15.123:0/156379673 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7f478c008780 msgr2=0x7f478c00abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:28:00.893 INFO:tasks.workunit.client.0.smithi123.stderr: Image migration: 100% complete...done. 2023-12-06T15:28:00.896 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration abort test2 2023-12-06T15:28:01.007 INFO:tasks.workunit.client.0.smithi123.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-12-06T15:28:01.007+0000 7fc6228fd700 0 -- 172.21.15.123:0/3154542647 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7fc600008780 msgr2=0x7fc60000abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:28:01.007 INFO:tasks.workunit.client.0.smithi123.stderr: Abort image migration: 100% complete...done. 2023-12-06T15:28:01.009 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-12-06T15:28:01.050 INFO:tasks.workunit.client.0.smithi123.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T15:28:01.053 INFO:tasks.workunit.client.0.smithi123.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T15:28:01.053 INFO:tasks.workunit.client.0.smithi123.stdout:elapsed: 0 ops: 1 ops/sec: 500.012 bytes/sec: 500 KiB/s 2023-12-06T15:28:01.059 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test2 2023-12-06T15:28:01.172 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-12-06T15:28:01.172+0000 7fee9a433700 0 -- 172.21.15.123:0/4186148017 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7fee80008780 msgr2=0x7fee8000abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T15:28:01.173 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:28:01.175 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create -s 128M --image-format 2 test2 2023-12-06T15:28:01.216 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration prepare test2 --data-pool INVALID_DATA_POOL 2023-12-06T15:28:01.299 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:28:01.299+0000 7f4ea9128380 -1 librbd::image::CreateRequest: 0x56190182e690 validate_data_pool: data pool INVALID_DATA_POOL does not exist 2023-12-06T15:28:01.299 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:28:01.299+0000 7f4ea9128380 -1 librbd::Migration: create_dst_image: header creation failed: (2) No such file or directory 2023-12-06T15:28:01.323 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: preparing migration failed: (2) No such file or directory 2023-12-06T15:28:01.326 INFO:tasks.workunit.client.0.smithi123.stderr:+ true 2023-12-06T15:28:01.326 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-12-06T15:28:01.366 INFO:tasks.workunit.client.0.smithi123.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T15:28:01.369 INFO:tasks.workunit.client.0.smithi123.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T15:28:01.369 INFO:tasks.workunit.client.0.smithi123.stdout:elapsed: 0 ops: 1 ops/sec: 250.006 bytes/sec: 250 KiB/s 2023-12-06T15:28:01.378 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test2 2023-12-06T15:28:01.492 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-12-06T15:28:01.492+0000 7fe52ef00700 0 -- 172.21.15.123:0/4038245306 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x562673aa25c0 msgr2=0x562673a7cc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:28:01.492 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:28:01.495 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create -s 128M --image-format 2 test2 2023-12-06T15:28:01.538 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration prepare test2 rbd2/test2 2023-12-06T15:28:01.663 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 rbd2/test2 2023-12-06T15:28:01.707 INFO:tasks.workunit.client.0.smithi123.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T15:28:01.713 INFO:tasks.workunit.client.0.smithi123.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T15:28:01.713 INFO:tasks.workunit.client.0.smithi123.stdout:elapsed: 0 ops: 1 ops/sec: 166.671 bytes/sec: 167 KiB/s 2023-12-06T15:28:01.725 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration abort test2 2023-12-06T15:28:01.817 INFO:tasks.workunit.client.0.smithi123.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete... Abort image migration: 100% complete...done. 2023-12-06T15:28:01.820 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-12-06T15:28:01.861 INFO:tasks.workunit.client.0.smithi123.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T15:28:01.863 INFO:tasks.workunit.client.0.smithi123.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T15:28:01.863 INFO:tasks.workunit.client.0.smithi123.stdout:elapsed: 0 ops: 1 ops/sec: 500.012 bytes/sec: 500 KiB/s 2023-12-06T15:28:01.871 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test2 2023-12-06T15:28:01.993 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-12-06T15:28:01.993+0000 7f61e9a00700 0 -- 172.21.15.123:0/3665621134 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7f61d0014c80 msgr2=0x7f61d0011df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:28:01.993 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:28:01.995 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create -s 128M --image-format 2 test2 2023-12-06T15:28:02.038 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration prepare test2 rbd2/test2 2023-12-06T15:28:02.137 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:28:02.137+0000 7f68bf50d700 0 -- 172.21.15.123:0/3149688214 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x562776293360 msgr2=0x5627762ecb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:28:02.140 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration abort rbd2/test2 2023-12-06T15:28:02.224 INFO:tasks.workunit.client.0.smithi123.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete... Abort image migration: 100% complete...done. 2023-12-06T15:28:02.226 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-12-06T15:28:02.270 INFO:tasks.workunit.client.0.smithi123.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T15:28:02.276 INFO:tasks.workunit.client.0.smithi123.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T15:28:02.277 INFO:tasks.workunit.client.0.smithi123.stdout:elapsed: 0 ops: 1 ops/sec: 142.861 bytes/sec: 143 KiB/s 2023-12-06T15:28:02.289 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test2 2023-12-06T15:28:02.404 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-12-06T15:28:02.404+0000 7f665d446700 0 -- 172.21.15.123:0/379994917 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7f663c0061b0 msgr2=0x7f663c0085a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T15:28:02.406 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:28:02.409 INFO:tasks.workunit.client.0.smithi123.stderr:+ test 2 = 1 2023-12-06T15:28:02.409 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create -s 128M --image-format 2 test2 2023-12-06T15:28:02.451 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration prepare test2 rbd2/ns1/test3 2023-12-06T15:28:02.547 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:28:02.547+0000 7f69bcb24700 0 -- 172.21.15.123:0/1875308480 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x5590bc83f2f0 msgr2=0x5590bc8e0f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:28:02.550 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 rbd2/ns1/test3 2023-12-06T15:28:02.595 INFO:tasks.workunit.client.0.smithi123.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T15:28:02.599 INFO:tasks.workunit.client.0.smithi123.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T15:28:02.599 INFO:tasks.workunit.client.0.smithi123.stdout:elapsed: 0 ops: 1 ops/sec: 200.005 bytes/sec: 200 KiB/s 2023-12-06T15:28:02.605 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd migration abort test2 2023-12-06T15:28:02.711 INFO:tasks.workunit.client.0.smithi123.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete... Abort image migration: 100% complete...done. 2023-12-06T15:28:02.713 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-12-06T15:28:02.755 INFO:tasks.workunit.client.0.smithi123.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T15:28:02.757 INFO:tasks.workunit.client.0.smithi123.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T15:28:02.757 INFO:tasks.workunit.client.0.smithi123.stdout:elapsed: 0 ops: 1 ops/sec: 500.012 bytes/sec: 500 KiB/s 2023-12-06T15:28:02.768 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test2 2023-12-06T15:28:02.883 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-12-06T15:28:02.883+0000 7f098ca06700 0 -- 172.21.15.123:0/4226055718 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7f0968008780 msgr2=0x7f096800abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T15:28:02.885 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:28:02.888 INFO:tasks.workunit.client.0.smithi123.stderr:+ remove_images 2023-12-06T15:28:02.888 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:02.962 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:03.036 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:03.111 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:03.185 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:03.270 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:03.346 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:03.421 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:03.698 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:03.779 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:04.057 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:04.138 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:04.211 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:04.284 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:04.357 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:04.428 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:04.503 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:04.576 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:04.651 INFO:tasks.workunit.client.0.smithi123.stderr:+ ceph osd pool rm rbd2 rbd2 --yes-i-really-really-mean-it 2023-12-06T15:28:05.314 INFO:tasks.workunit.client.0.smithi123.stderr:pool 'rbd2' does not exist 2023-12-06T15:28:05.324 INFO:tasks.workunit.client.0.smithi123.stderr:+ test_config 2023-12-06T15:28:05.324 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 'testing config...' 2023-12-06T15:28:05.324 INFO:tasks.workunit.client.0.smithi123.stdout:testing config... 2023-12-06T15:28:05.325 INFO:tasks.workunit.client.0.smithi123.stderr:+ remove_images 2023-12-06T15:28:05.325 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:05.405 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:05.477 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:05.550 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:05.624 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:05.698 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:05.771 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:05.846 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:05.920 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:05.994 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:06.068 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:06.140 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:06.213 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:06.292 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:06.370 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:06.444 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:06.523 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:06.595 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:06.668 INFO:tasks.workunit.client.0.smithi123.stderr:+ expect_fail rbd config global set osd rbd_cache true 2023-12-06T15:28:06.668 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config global set osd rbd_cache true 2023-12-06T15:28:06.689 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: invalid config entity: osd (must be global, client or client.) 2023-12-06T15:28:06.691 INFO:tasks.workunit.client.0.smithi123.stderr:+ return 0 2023-12-06T15:28:06.691 INFO:tasks.workunit.client.0.smithi123.stderr:+ expect_fail rbd config global set global debug_ms 10 2023-12-06T15:28:06.691 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config global set global debug_ms 10 2023-12-06T15:28:06.712 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: not rbd option: debug_ms 2023-12-06T15:28:06.713 INFO:tasks.workunit.client.0.smithi123.stderr:+ return 0 2023-12-06T15:28:06.713 INFO:tasks.workunit.client.0.smithi123.stderr:+ expect_fail rbd config global set global rbd_UNKNOWN false 2023-12-06T15:28:06.714 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config global set global rbd_UNKNOWN false 2023-12-06T15:28:06.736 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: invalid config key: rbd_UNKNOWN 2023-12-06T15:28:06.738 INFO:tasks.workunit.client.0.smithi123.stderr:+ return 0 2023-12-06T15:28:06.738 INFO:tasks.workunit.client.0.smithi123.stderr:+ expect_fail rbd config global set global rbd_cache INVALID 2023-12-06T15:28:06.738 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config global set global rbd_cache INVALID 2023-12-06T15:28:06.765 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: error setting rbd_cache: error parsing value: Expected option value to be integer, got 'INVALID' 2023-12-06T15:28:06.767 INFO:tasks.workunit.client.0.smithi123.stderr:+ return 0 2023-12-06T15:28:06.767 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config global set global rbd_cache false 2023-12-06T15:28:06.799 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config global set client rbd_cache true 2023-12-06T15:28:06.830 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config global set client.123 rbd_cache false 2023-12-06T15:28:06.862 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config global get global rbd_cache 2023-12-06T15:28:06.862 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^false$' 2023-12-06T15:28:06.889 INFO:tasks.workunit.client.0.smithi123.stdout:false 2023-12-06T15:28:06.890 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config global get client rbd_cache 2023-12-06T15:28:06.890 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^true$' 2023-12-06T15:28:06.917 INFO:tasks.workunit.client.0.smithi123.stdout:true 2023-12-06T15:28:06.918 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config global get client.123 rbd_cache 2023-12-06T15:28:06.918 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^false$' 2023-12-06T15:28:06.945 INFO:tasks.workunit.client.0.smithi123.stdout:false 2023-12-06T15:28:06.946 INFO:tasks.workunit.client.0.smithi123.stderr:+ expect_fail rbd config global get client.UNKNOWN rbd_cache 2023-12-06T15:28:06.946 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config global get client.UNKNOWN rbd_cache 2023-12-06T15:28:06.972 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: rbd_cache is not set 2023-12-06T15:28:06.974 INFO:tasks.workunit.client.0.smithi123.stderr:+ return 0 2023-12-06T15:28:06.974 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config global list global 2023-12-06T15:28:06.974 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^rbd_cache * false * global *$' 2023-12-06T15:28:07.002 INFO:tasks.workunit.client.0.smithi123.stdout:rbd_cache false global 2023-12-06T15:28:07.002 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config global list client 2023-12-06T15:28:07.003 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^rbd_cache * true * client *$' 2023-12-06T15:28:07.027 INFO:tasks.workunit.client.0.smithi123.stdout:rbd_cache true client 2023-12-06T15:28:07.028 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config global list client.123 2023-12-06T15:28:07.028 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^rbd_cache * false * client.123 *$' 2023-12-06T15:28:07.054 INFO:tasks.workunit.client.0.smithi123.stdout:rbd_cache false client.123 2023-12-06T15:28:07.055 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config global list client.UNKNOWN 2023-12-06T15:28:07.055 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^rbd_cache * true * client *$' 2023-12-06T15:28:07.081 INFO:tasks.workunit.client.0.smithi123.stdout:rbd_cache true client 2023-12-06T15:28:07.081 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config global rm client rbd_cache 2023-12-06T15:28:07.112 INFO:tasks.workunit.client.0.smithi123.stderr:+ expect_fail rbd config global get client rbd_cache 2023-12-06T15:28:07.112 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config global get client rbd_cache 2023-12-06T15:28:07.138 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: rbd_cache is not set 2023-12-06T15:28:07.139 INFO:tasks.workunit.client.0.smithi123.stderr:+ return 0 2023-12-06T15:28:07.140 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config global list client 2023-12-06T15:28:07.140 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^rbd_cache * false * global *$' 2023-12-06T15:28:07.166 INFO:tasks.workunit.client.0.smithi123.stdout:rbd_cache false global 2023-12-06T15:28:07.167 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config global rm client.123 rbd_cache 2023-12-06T15:28:07.197 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config global rm global rbd_cache 2023-12-06T15:28:07.229 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config pool set rbd rbd_cache true 2023-12-06T15:28:07.267 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config pool list rbd 2023-12-06T15:28:07.267 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^rbd_cache * true * pool *$' 2023-12-06T15:28:07.294 INFO:tasks.workunit.client.0.smithi123.stdout:rbd_cache true pool 2023-12-06T15:28:07.295 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config pool get rbd rbd_cache 2023-12-06T15:28:07.295 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^true$' 2023-12-06T15:28:07.323 INFO:tasks.workunit.client.0.smithi123.stdout:true 2023-12-06T15:28:07.323 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create -s 1 test1 2023-12-06T15:28:07.348 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:28:07.349+0000 7f6692001380 -1 librbd: Forced V1 image creation. 2023-12-06T15:28:07.355 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config image list rbd/test1 2023-12-06T15:28:07.356 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^rbd_cache * true * pool *$' 2023-12-06T15:28:07.392 INFO:tasks.workunit.client.0.smithi123.stdout:rbd_cache true pool 2023-12-06T15:28:07.392 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config image set rbd/test1 rbd_cache false 2023-12-06T15:28:07.433 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config image list rbd/test1 2023-12-06T15:28:07.433 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^rbd_cache * false * image *$' 2023-12-06T15:28:07.469 INFO:tasks.workunit.client.0.smithi123.stdout:rbd_cache false image 2023-12-06T15:28:07.469 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config image get rbd/test1 rbd_cache 2023-12-06T15:28:07.469 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^false$' 2023-12-06T15:28:07.505 INFO:tasks.workunit.client.0.smithi123.stdout:false 2023-12-06T15:28:07.505 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config image remove rbd/test1 rbd_cache 2023-12-06T15:28:07.547 INFO:tasks.workunit.client.0.smithi123.stderr:+ expect_fail rbd config image get rbd/test1 rbd_cache 2023-12-06T15:28:07.547 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config image get rbd/test1 rbd_cache 2023-12-06T15:28:07.578 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: rbd_cache is not set 2023-12-06T15:28:07.583 INFO:tasks.workunit.client.0.smithi123.stderr:+ return 0 2023-12-06T15:28:07.583 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config image list rbd/test1 2023-12-06T15:28:07.583 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^rbd_cache * true * pool *$' 2023-12-06T15:28:07.621 INFO:tasks.workunit.client.0.smithi123.stdout:rbd_cache true pool 2023-12-06T15:28:07.622 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config pool remove rbd rbd_cache 2023-12-06T15:28:07.649 INFO:tasks.workunit.client.0.smithi123.stderr:+ expect_fail rbd config pool get rbd rbd_cache 2023-12-06T15:28:07.649 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config pool get rbd rbd_cache 2023-12-06T15:28:07.676 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: rbd_cache is not set 2023-12-06T15:28:07.678 INFO:tasks.workunit.client.0.smithi123.stderr:+ return 0 2023-12-06T15:28:07.678 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd config pool list rbd 2023-12-06T15:28:07.678 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^rbd_cache * true * config *$' 2023-12-06T15:28:07.706 INFO:tasks.workunit.client.0.smithi123.stdout:rbd_cache true config 2023-12-06T15:28:07.706 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test1 2023-12-06T15:28:07.744 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:28:07.747 INFO:tasks.workunit.client.0.smithi123.stderr:+ RBD_CREATE_ARGS= 2023-12-06T15:28:07.747 INFO:tasks.workunit.client.0.smithi123.stderr:+ test_others 2023-12-06T15:28:07.747 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 'testing import, export, resize, and snapshots...' 2023-12-06T15:28:07.748 INFO:tasks.workunit.client.0.smithi123.stdout:testing import, export, resize, and snapshots... 2023-12-06T15:28:07.748 INFO:tasks.workunit.client.0.smithi123.stderr:+ TMP_FILES='/tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1' 2023-12-06T15:28:07.748 INFO:tasks.workunit.client.0.smithi123.stderr:+ remove_images 2023-12-06T15:28:07.748 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:07.829 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:07.902 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:07.975 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:08.049 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:08.123 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:08.196 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:08.271 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:08.344 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:08.418 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:08.495 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:08.773 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:08.849 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:08.924 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:08.996 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:09.068 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:09.145 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:09.219 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:09.292 INFO:tasks.workunit.client.0.smithi123.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2023-12-06T15:28:09.293 INFO:tasks.workunit.client.0.smithi123.stderr:+ dd if=/bin/sh of=/tmp/img1 bs=1k count=1 seek=10 2023-12-06T15:28:09.294 INFO:tasks.workunit.client.0.smithi123.stderr:1+0 records in 2023-12-06T15:28:09.294 INFO:tasks.workunit.client.0.smithi123.stderr:1+0 records out 2023-12-06T15:28:09.294 INFO:tasks.workunit.client.0.smithi123.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 4.1132e-05 s, 24.9 MB/s 2023-12-06T15:28:09.294 INFO:tasks.workunit.client.0.smithi123.stderr:+ dd if=/bin/dd of=/tmp/img1 bs=1k count=10 seek=100 2023-12-06T15:28:09.294 INFO:tasks.workunit.client.0.smithi123.stderr:10+0 records in 2023-12-06T15:28:09.295 INFO:tasks.workunit.client.0.smithi123.stderr:10+0 records out 2023-12-06T15:28:09.295 INFO:tasks.workunit.client.0.smithi123.stderr:10240 bytes (10 kB, 10 KiB) copied, 6.4202e-05 s, 159 MB/s 2023-12-06T15:28:09.295 INFO:tasks.workunit.client.0.smithi123.stderr:+ dd if=/bin/rm of=/tmp/img1 bs=1k count=100 seek=1000 2023-12-06T15:28:09.295 INFO:tasks.workunit.client.0.smithi123.stderr:70+1 records in 2023-12-06T15:28:09.295 INFO:tasks.workunit.client.0.smithi123.stderr:70+1 records out 2023-12-06T15:28:09.296 INFO:tasks.workunit.client.0.smithi123.stderr:72208 bytes (72 kB, 71 KiB) copied, 0.000170108 s, 424 MB/s 2023-12-06T15:28:09.296 INFO:tasks.workunit.client.0.smithi123.stderr:+ dd if=/bin/ls of=/tmp/img1 bs=1k seek=10000 2023-12-06T15:28:09.297 INFO:tasks.workunit.client.0.smithi123.stderr:140+1 records in 2023-12-06T15:28:09.297 INFO:tasks.workunit.client.0.smithi123.stderr:140+1 records out 2023-12-06T15:28:09.297 INFO:tasks.workunit.client.0.smithi123.stderr:143376 bytes (143 kB, 140 KiB) copied, 0.00035245 s, 407 MB/s 2023-12-06T15:28:09.297 INFO:tasks.workunit.client.0.smithi123.stderr:+ dd if=/bin/ln of=/tmp/img1 bs=1k seek=100000 2023-12-06T15:28:09.297 INFO:tasks.workunit.client.0.smithi123.stderr:70+1 records in 2023-12-06T15:28:09.298 INFO:tasks.workunit.client.0.smithi123.stderr:70+1 records out 2023-12-06T15:28:09.298 INFO:tasks.workunit.client.0.smithi123.stderr:72312 bytes (72 kB, 71 KiB) copied, 0.00017328 s, 417 MB/s 2023-12-06T15:28:09.298 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd import /tmp/img1 testimg1 2023-12-06T15:28:09.323 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:28:09.323+0000 7f10bdc2a380 -1 librbd: Forced V1 image creation. 2023-12-06T15:28:09.400 INFO:tasks.workunit.client.0.smithi123.stderr: Importing image: 4% complete... Importing image: 8% complete... Importing image: 12% complete... Importing image: 16% complete... Importing image: 20% complete... Importing image: 24% complete... Importing image: 28% complete... Importing image: 32% complete... Importing image: 36% complete... Importing image: 40% complete... Importing image: 45% complete... Importing image: 49% complete... Importing image: 53% complete... Importing image: 57% complete... Importing image: 61% complete... Importing image: 65% complete... Importing image: 69% complete... Importing image: 73% complete... Importing image: 77% complete... Importing image: 81% complete... Importing image: 85% complete... Importing image: 90% complete... Importing image: 94% complete... Importing image: 98% complete... Importing image: 100% complete...done. 2023-12-06T15:28:09.402 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd resize testimg1 --size=256 --allow-shrink 2023-12-06T15:28:09.436 INFO:tasks.workunit.client.0.smithi123.stderr: Resizing image: 100% complete...done. 2023-12-06T15:28:09.440 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd export testimg1 /tmp/img2 2023-12-06T15:28:09.529 INFO:tasks.workunit.client.0.smithi123.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-12-06T15:28:09.531 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create testimg1 --snap=snap1 2023-12-06T15:28:10.209 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:28:10.214 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd resize testimg1 --size=128 2023-12-06T15:28:10.249 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: shrinking an image is only allowed with the --allow-shrink flag 2023-12-06T15:28:10.255 INFO:tasks.workunit.client.0.smithi123.stderr:+ true 2023-12-06T15:28:10.255 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd resize testimg1 --size=128 --allow-shrink 2023-12-06T15:28:10.304 INFO:tasks.workunit.client.0.smithi123.stderr: Resizing image: 50% complete... Resizing image: 51% complete... Resizing image: 53% complete... Resizing image: 54% complete... Resizing image: 56% complete... Resizing image: 57% complete... Resizing image: 59% complete... Resizing image: 60% complete... Resizing image: 62% complete... Resizing image: 64% complete... Resizing image: 65% complete... Resizing image: 67% complete... Resizing image: 68% complete... Resizing image: 70% complete... Resizing image: 71% complete... Resizing image: 73% complete... Resizing image: 75% complete... Resizing image: 76% complete... Resizing image: 78% complete... Resizing image: 79% complete... Resizing image: 81% complete... Resizing image: 82% complete... Resizing image: 84% complete... Resizing image: 85% complete... Resizing image: 87% complete... Resizing image: 89% complete... Resizing image: 90% complete... Resizing image: 92% complete... Resizing image: 93% complete... Resizing image: 95% complete... Resizing image: 96% complete... Resizing image: 98% complete... Resizing image: 100% complete...done. 2023-12-06T15:28:10.308 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd export testimg1 /tmp/img3 2023-12-06T15:28:10.372 INFO:tasks.workunit.client.0.smithi123.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-12-06T15:28:10.375 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info testimg1 2023-12-06T15:28:10.375 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'size 128 MiB' 2023-12-06T15:28:10.405 INFO:tasks.workunit.client.0.smithi123.stdout: size 128 MiB in 32 objects 2023-12-06T15:28:10.406 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info --snap=snap1 testimg1 2023-12-06T15:28:10.406 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'size 256 MiB' 2023-12-06T15:28:10.437 INFO:tasks.workunit.client.0.smithi123.stdout: size 256 MiB in 64 objects 2023-12-06T15:28:10.438 INFO:tasks.workunit.client.0.smithi123.stderr:+ rm -rf /tmp/diff-testimg1-1 /tmp/diff-testimg1-2 2023-12-06T15:28:10.438 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd export-diff testimg1 --snap=snap1 /tmp/diff-testimg1-1 2023-12-06T15:28:10.528 INFO:tasks.workunit.client.0.smithi123.stderr: Exporting image: 3% complete... Exporting image: 37% complete... Exporting image: 100% complete...done. 2023-12-06T15:28:10.532 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd export-diff testimg1 --from-snap=snap1 /tmp/diff-testimg1-2 2023-12-06T15:28:10.588 INFO:tasks.workunit.client.0.smithi123.stderr: Exporting image: 100% complete...done. 2023-12-06T15:28:10.591 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --size=1 testimg-diff1 2023-12-06T15:28:10.617 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:28:10.617+0000 7fb9849e7380 -1 librbd: Forced V1 image creation. 2023-12-06T15:28:10.625 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-1 testimg-diff1 2023-12-06T15:28:11.215 INFO:tasks.workunit.client.0.smithi123.stderr: Importing image diff: 22% complete... Importing image diff: 63% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2023-12-06T15:28:11.221 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-2 testimg-diff1 2023-12-06T15:28:11.285 INFO:tasks.workunit.client.0.smithi123.stderr: Importing image diff: 68% complete... Importing image diff: 96% complete... Importing image diff: 100% complete...done. 2023-12-06T15:28:11.290 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info testimg1 2023-12-06T15:28:11.290 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'size 128 MiB' 2023-12-06T15:28:11.323 INFO:tasks.workunit.client.0.smithi123.stdout: size 128 MiB in 32 objects 2023-12-06T15:28:11.323 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info --snap=snap1 testimg1 2023-12-06T15:28:11.323 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'size 256 MiB' 2023-12-06T15:28:11.355 INFO:tasks.workunit.client.0.smithi123.stdout: size 256 MiB in 64 objects 2023-12-06T15:28:11.356 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info testimg-diff1 2023-12-06T15:28:11.356 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'size 128 MiB' 2023-12-06T15:28:11.385 INFO:tasks.workunit.client.0.smithi123.stdout: size 128 MiB in 32 objects 2023-12-06T15:28:11.386 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info --snap=snap1 testimg-diff1 2023-12-06T15:28:11.386 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'size 256 MiB' 2023-12-06T15:28:11.417 INFO:tasks.workunit.client.0.smithi123.stdout: size 256 MiB in 64 objects 2023-12-06T15:28:11.417 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd copy testimg1 --snap=snap1 testimg2 2023-12-06T15:28:11.508 INFO:tasks.workunit.client.0.smithi123.stderr: Image copy: 1% complete... Image copy: 3% complete... Image copy: 4% complete... Image copy: 6% complete... Image copy: 7% complete... Image copy: 9% complete... Image copy: 10% complete... Image copy: 12% complete... Image copy: 14% complete... Image copy: 15% complete... Image copy: 17% complete... Image copy: 18% complete... Image copy: 20% complete... Image copy: 21% complete... Image copy: 23% complete... Image copy: 25% complete... Image copy: 26% complete... Image copy: 28% complete... Image copy: 29% complete... Image copy: 31% complete... Image copy: 32% complete... Image copy: 34% complete... Image copy: 35% complete... Image copy: 37% complete... Image copy: 39% complete... Image copy: 40% complete... Image copy: 42% complete... Image copy: 43% complete... Image copy: 45% complete... Image copy: 46% complete... Image copy: 48% complete... Image copy: 50% complete... Image copy: 51% complete... Image copy: 53% complete... Image copy: 54% complete... Image copy: 56% complete... Image copy: 57% complete... Image copy: 59% complete... Image copy: 60% complete... Image copy: 62% complete... Image copy: 64% complete... Image copy: 65% complete... Image copy: 67% complete... Image copy: 68% complete... Image copy: 70% complete... Image copy: 71% complete... Image copy: 73% complete... Image copy: 75% complete... Image copy: 76% complete... Image copy: 78% complete... Image copy: 79% complete... Image copy: 81% complete... Image copy: 82% complete... Image copy: 84% complete... Image copy: 85% complete... Image copy: 87% complete... Image copy: 89% complete... Image copy: 90% complete... Image copy: 92% complete... Image copy: 93% complete... Image copy: 95% complete... Image copy: 96% complete... Image copy: 98% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-12-06T15:28:11.512 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd copy testimg1 testimg3 2023-12-06T15:28:11.600 INFO:tasks.workunit.client.0.smithi123.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-12-06T15:28:11.604 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd copy testimg-diff1 --sparse-size 768K --snap=snap1 testimg-diff2 2023-12-06T15:28:11.706 INFO:tasks.workunit.client.0.smithi123.stderr: Image copy: 1% complete... Image copy: 3% complete... Image copy: 4% complete... Image copy: 6% complete... Image copy: 7% complete... Image copy: 9% complete... Image copy: 10% complete... Image copy: 12% complete... Image copy: 14% complete... Image copy: 15% complete... Image copy: 17% complete... Image copy: 18% complete... Image copy: 20% complete... Image copy: 21% complete... Image copy: 23% complete... Image copy: 25% complete... Image copy: 26% complete... Image copy: 28% complete... Image copy: 29% complete... Image copy: 31% complete... Image copy: 32% complete... Image copy: 34% complete... Image copy: 35% complete... Image copy: 37% complete... Image copy: 39% complete... Image copy: 40% complete... Image copy: 42% complete... Image copy: 43% complete... Image copy: 45% complete... Image copy: 46% complete... Image copy: 48% complete... Image copy: 50% complete... Image copy: 51% complete... Image copy: 53% complete... Image copy: 54% complete... Image copy: 56% complete... Image copy: 57% complete... Image copy: 59% complete... Image copy: 60% complete... Image copy: 62% complete... Image copy: 64% complete... Image copy: 65% complete... Image copy: 67% complete... Image copy: 68% complete... Image copy: 70% complete... Image copy: 71% complete... Image copy: 73% complete... Image copy: 75% complete... Image copy: 76% complete... Image copy: 78% complete... Image copy: 79% complete... Image copy: 81% complete... Image copy: 82% complete... Image copy: 84% complete... Image copy: 85% complete... Image copy: 87% complete... Image copy: 89% complete... Image copy: 90% complete... Image copy: 92% complete... Image copy: 93% complete... Image copy: 95% complete... Image copy: 96% complete... Image copy: 98% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-12-06T15:28:11.710 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd copy testimg-diff1 --sparse-size 768K testimg-diff3 2023-12-06T15:28:11.802 INFO:tasks.workunit.client.0.smithi123.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-12-06T15:28:11.805 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info testimg2 2023-12-06T15:28:11.805 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'size 256 MiB' 2023-12-06T15:28:11.837 INFO:tasks.workunit.client.0.smithi123.stdout: size 256 MiB in 64 objects 2023-12-06T15:28:11.838 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info testimg3 2023-12-06T15:28:11.838 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'size 128 MiB' 2023-12-06T15:28:11.870 INFO:tasks.workunit.client.0.smithi123.stdout: size 128 MiB in 32 objects 2023-12-06T15:28:11.870 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info testimg-diff2 2023-12-06T15:28:11.870 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'size 256 MiB' 2023-12-06T15:28:11.902 INFO:tasks.workunit.client.0.smithi123.stdout: size 256 MiB in 64 objects 2023-12-06T15:28:11.903 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info testimg-diff3 2023-12-06T15:28:11.903 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'size 128 MiB' 2023-12-06T15:28:11.937 INFO:tasks.workunit.client.0.smithi123.stdout: size 128 MiB in 32 objects 2023-12-06T15:28:11.938 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd deep copy testimg1 testimg4 2023-12-06T15:28:12.314 INFO:tasks.workunit.client.0.smithi123.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-12-06T15:28:12.317 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd deep copy testimg1 --snap=snap1 testimg5 2023-12-06T15:28:13.285 INFO:tasks.workunit.client.0.smithi123.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete...2023-12-06T15:28:13.279+0000 7f6dadad9700 0 -- 172.21.15.123:0/801048793 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7f6d8c001c20 msgr2=0x7f6d9003bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:28:13.298 INFO:tasks.workunit.client.0.smithi123.stderr: Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-12-06T15:28:13.301 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info testimg4 2023-12-06T15:28:13.301 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'size 128 MiB' 2023-12-06T15:28:13.333 INFO:tasks.workunit.client.0.smithi123.stdout: size 128 MiB in 32 objects 2023-12-06T15:28:13.334 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info testimg5 2023-12-06T15:28:13.334 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'size 256 MiB' 2023-12-06T15:28:13.366 INFO:tasks.workunit.client.0.smithi123.stdout: size 256 MiB in 64 objects 2023-12-06T15:28:13.367 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap ls testimg4 2023-12-06T15:28:13.367 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -v SNAPID 2023-12-06T15:28:13.367 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:28:13.367 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 1 2023-12-06T15:28:13.398 INFO:tasks.workunit.client.0.smithi123.stdout:1 2023-12-06T15:28:13.399 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap ls testimg4 2023-12-06T15:28:13.399 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '.*snap1.*' 2023-12-06T15:28:13.431 INFO:tasks.workunit.client.0.smithi123.stdout: 18 snap1 256 MiB Wed Dec 6 15:28:12 2023 2023-12-06T15:28:13.432 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd export testimg1 /tmp/img1.new 2023-12-06T15:28:13.495 INFO:tasks.workunit.client.0.smithi123.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-12-06T15:28:13.498 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd export testimg2 /tmp/img2.new 2023-12-06T15:28:13.599 INFO:tasks.workunit.client.0.smithi123.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-12-06T15:28:13.602 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd export testimg3 /tmp/img3.new 2023-12-06T15:28:13.678 INFO:tasks.workunit.client.0.smithi123.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-12-06T15:28:13.680 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.new 2023-12-06T15:28:13.750 INFO:tasks.workunit.client.0.smithi123.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-12-06T15:28:13.753 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd export testimg-diff2 /tmp/img-diff2.new 2023-12-06T15:28:13.853 INFO:tasks.workunit.client.0.smithi123.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-12-06T15:28:13.856 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd export testimg-diff3 /tmp/img-diff3.new 2023-12-06T15:28:13.928 INFO:tasks.workunit.client.0.smithi123.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-12-06T15:28:13.931 INFO:tasks.workunit.client.0.smithi123.stderr:+ cmp /tmp/img2 /tmp/img2.new 2023-12-06T15:28:14.123 INFO:tasks.workunit.client.0.smithi123.stderr:+ cmp /tmp/img3 /tmp/img3.new 2023-12-06T15:28:14.216 INFO:tasks.workunit.client.0.smithi123.stderr:+ cmp /tmp/img2 /tmp/img-diff2.new 2023-12-06T15:28:14.373 INFO:tasks.workunit.client.0.smithi123.stderr:+ cmp /tmp/img3 /tmp/img-diff3.new 2023-12-06T15:28:14.450 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap rollback --snap=snap1 testimg1 2023-12-06T15:28:14.550 INFO:tasks.workunit.client.0.smithi123.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2023-12-06T15:28:14.555 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap rollback --snap=snap1 testimg-diff1 2023-12-06T15:28:14.643 INFO:tasks.workunit.client.0.smithi123.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2023-12-06T15:28:14.649 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info testimg1 2023-12-06T15:28:14.650 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'size 256 MiB' 2023-12-06T15:28:14.680 INFO:tasks.workunit.client.0.smithi123.stdout: size 256 MiB in 64 objects 2023-12-06T15:28:14.680 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info testimg-diff1 2023-12-06T15:28:14.680 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'size 256 MiB' 2023-12-06T15:28:14.710 INFO:tasks.workunit.client.0.smithi123.stdout: size 256 MiB in 64 objects 2023-12-06T15:28:14.710 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd export testimg1 /tmp/img1.snap1 2023-12-06T15:28:14.807 INFO:tasks.workunit.client.0.smithi123.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-12-06T15:28:14.810 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.snap1 2023-12-06T15:28:14.917 INFO:tasks.workunit.client.0.smithi123.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-12-06T15:28:14.919 INFO:tasks.workunit.client.0.smithi123.stderr:+ cmp /tmp/img2 /tmp/img1.snap1 2023-12-06T15:28:15.067 INFO:tasks.workunit.client.0.smithi123.stderr:+ cmp /tmp/img2 /tmp/img-diff1.snap1 2023-12-06T15:28:15.213 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm testimg2 2023-12-06T15:28:15.308 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete...2023-12-06T15:28:15.308+0000 7f0833e26700 0 -- 172.21.15.123:0/437124420 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x56060aa594e0 msgr2=0x56060aafd0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:28:15.329 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 98% complete... Removing image: 100% complete...done. 2023-12-06T15:28:15.331 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm testimg3 2023-12-06T15:28:15.412 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-12-06T15:28:15.415 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create testimg2 -s 0 2023-12-06T15:28:15.441 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:28:15.441+0000 7f4bf7f88380 -1 librbd: Forced V1 image creation. 2023-12-06T15:28:15.447 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd cp testimg2 testimg3 2023-12-06T15:28:15.503 INFO:tasks.workunit.client.0.smithi123.stderr: Image copy: 100% complete...done. 2023-12-06T15:28:15.506 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd deep cp testimg2 testimg6 2023-12-06T15:28:15.565 INFO:tasks.workunit.client.0.smithi123.stderr: Image deep copy: 100% complete...done. 2023-12-06T15:28:15.568 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap rm --snap=snap1 testimg1 2023-12-06T15:28:16.229 INFO:tasks.workunit.client.0.smithi123.stderr: Removing snap: 100% complete...done. 2023-12-06T15:28:16.239 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap rm --snap=snap1 testimg-diff1 2023-12-06T15:28:17.244 INFO:tasks.workunit.client.0.smithi123.stderr: Removing snap: 100% complete...done. 2023-12-06T15:28:17.252 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info --snap=snap1 testimg1 2023-12-06T15:28:17.253 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2023-12-06T15:28:17.291 INFO:tasks.workunit.client.0.smithi123.stdout:error setting snapshot context: (2) No such file or directory 2023-12-06T15:28:17.292 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info --snap=snap1 testimg-diff1 2023-12-06T15:28:17.292 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2023-12-06T15:28:17.326 INFO:tasks.workunit.client.0.smithi123.stdout:error setting snapshot context: (2) No such file or directory 2023-12-06T15:28:17.326 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd sparsify testimg1 2023-12-06T15:28:17.429 INFO:tasks.workunit.client.0.smithi123.stderr: Image sparsify: 1% complete... Image sparsify: 3% complete... Image sparsify: 4% complete... Image sparsify: 6% complete... Image sparsify: 7% complete... Image sparsify: 9% complete... Image sparsify: 10% complete... Image sparsify: 12% complete... Image sparsify: 14% complete... Image sparsify: 15% complete... Image sparsify: 17% complete... Image sparsify: 18% complete... Image sparsify: 20% complete... Image sparsify: 21% complete... Image sparsify: 23% complete... Image sparsify: 25% complete... Image sparsify: 26% complete... Image sparsify: 28% complete... Image sparsify: 29% complete... Image sparsify: 31% complete... Image sparsify: 32% complete... Image sparsify: 34% complete... Image sparsify: 35% complete... Image sparsify: 37% complete... Image sparsify: 39% complete... Image sparsify: 40% complete... Image sparsify: 42% complete... Image sparsify: 43% complete... Image sparsify: 45% complete... Image sparsify: 46% complete... Image sparsify: 48% complete... Image sparsify: 50% complete... Image sparsify: 51% complete... Image sparsify: 53% complete... Image sparsify: 54% complete... Image sparsify: 56% complete... Image sparsify: 57% complete... Image sparsify: 59% complete... Image sparsify: 60% complete... Image sparsify: 62% complete... Image sparsify: 64% complete... Image sparsify: 65% complete... Image sparsify: 67% complete... Image sparsify: 68% complete... Image sparsify: 70% complete... Image sparsify: 71% complete... Image sparsify: 73% complete... Image sparsify: 75% complete... Image sparsify: 76% complete... Image sparsify: 78% complete... Image sparsify: 79% complete... Image sparsify: 81% complete... Image sparsify: 82% complete... Image sparsify: 84% complete... Image sparsify: 85% complete... Image sparsify: 87% complete... Image sparsify: 89% complete... Image sparsify: 90% complete... Image sparsify: 92% complete... Image sparsify: 93% complete... Image sparsify: 95% complete... Image sparsify: 96% complete... Image sparsify: 98% complete... Image sparsify: 100% complete...done. 2023-12-06T15:28:17.438 INFO:tasks.workunit.client.0.smithi123.stderr:+ remove_images 2023-12-06T15:28:17.438 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:17.566 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:17.647 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:17.761 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:18.352 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:19.395 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:19.510 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:19.613 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:19.752 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:19.885 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:19.964 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:20.040 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:20.315 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:20.391 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:20.465 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:20.538 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:20.812 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:20.887 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:20.961 INFO:tasks.workunit.client.0.smithi123.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2023-12-06T15:28:21.067 INFO:tasks.workunit.client.0.smithi123.stderr:+ test_locking 2023-12-06T15:28:21.067 INFO:tasks.workunit.client.0.smithi123.stdout:testing locking... 2023-12-06T15:28:21.067 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 'testing locking...' 2023-12-06T15:28:21.067 INFO:tasks.workunit.client.0.smithi123.stderr:+ remove_images 2023-12-06T15:28:21.068 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:21.141 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:21.217 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:21.296 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:21.374 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:21.451 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:21.524 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:21.598 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:21.672 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:21.745 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:21.820 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:21.892 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:21.964 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:22.038 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:22.111 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:22.188 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:22.266 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:22.341 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:22.415 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create -s 1 test1 2023-12-06T15:28:22.440 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:28:22.440+0000 7f598c9c3380 -1 librbd: Forced V1 image creation. 2023-12-06T15:28:22.448 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd lock list test1 2023-12-06T15:28:22.448 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:28:22.448 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^0$' 2023-12-06T15:28:22.478 INFO:tasks.workunit.client.0.smithi123.stdout:0 2023-12-06T15:28:22.478 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd lock add test1 id 2023-12-06T15:28:22.516 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd lock list test1 2023-12-06T15:28:22.516 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep ' 1 ' 2023-12-06T15:28:22.545 INFO:tasks.workunit.client.0.smithi123.stdout:There is 1 exclusive lock on this image. 2023-12-06T15:28:22.546 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd lock list test1 2023-12-06T15:28:22.546 INFO:tasks.workunit.client.0.smithi123.stderr:++ tail -n 1 2023-12-06T15:28:22.546 INFO:tasks.workunit.client.0.smithi123.stderr:++ awk '{print $1;}' 2023-12-06T15:28:22.576 INFO:tasks.workunit.client.0.smithi123.stderr:+ LOCKER=client.7768 2023-12-06T15:28:22.577 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd lock remove test1 id client.7768 2023-12-06T15:28:23.254 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd lock list test1 2023-12-06T15:28:23.254 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:28:23.254 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^0$' 2023-12-06T15:28:23.286 INFO:tasks.workunit.client.0.smithi123.stdout:0 2023-12-06T15:28:23.286 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd lock add test1 id --shared tag 2023-12-06T15:28:23.326 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd lock list test1 2023-12-06T15:28:23.326 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep ' 1 ' 2023-12-06T15:28:23.357 INFO:tasks.workunit.client.0.smithi123.stdout:There is 1 shared lock on this image. 2023-12-06T15:28:23.357 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd lock add test1 id --shared tag 2023-12-06T15:28:23.396 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd lock list test1 2023-12-06T15:28:23.396 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep ' 2 ' 2023-12-06T15:28:23.426 INFO:tasks.workunit.client.0.smithi123.stdout:There are 2 shared locks on this image. 2023-12-06T15:28:23.426 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd lock add test1 id2 --shared tag 2023-12-06T15:28:23.464 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd lock list test1 2023-12-06T15:28:23.464 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep ' 3 ' 2023-12-06T15:28:23.494 INFO:tasks.workunit.client.0.smithi123.stdout:There are 3 shared locks on this image. 2023-12-06T15:28:23.495 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd lock list test1 2023-12-06T15:28:23.495 INFO:tasks.workunit.client.0.smithi123.stderr:+ tail -n 1 2023-12-06T15:28:23.495 INFO:tasks.workunit.client.0.smithi123.stderr:+ awk '{print $2, $1;}' 2023-12-06T15:28:23.495 INFO:tasks.workunit.client.0.smithi123.stderr:+ xargs rbd lock remove test1 2023-12-06T15:28:24.258 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info test1 2023-12-06T15:28:24.259 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -qE 'features:.*exclusive' 2023-12-06T15:28:24.295 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test1 2023-12-06T15:28:24.339 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:28:24.341 INFO:tasks.workunit.client.0.smithi123.stderr:+ test_thick_provision 2023-12-06T15:28:24.341 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 'testing thick provision...' 2023-12-06T15:28:24.342 INFO:tasks.workunit.client.0.smithi123.stdout:testing thick provision... 2023-12-06T15:28:24.342 INFO:tasks.workunit.client.0.smithi123.stderr:+ remove_images 2023-12-06T15:28:24.342 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:24.416 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:24.488 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:24.561 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:24.635 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:24.710 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:24.784 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:24.859 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:24.933 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:25.018 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:25.079 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:25.152 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:25.224 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:25.296 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:25.373 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:25.450 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:25.520 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:25.593 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:25.666 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --thick-provision -s 64M test1 2023-12-06T15:28:25.693 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:28:25.693+0000 7fa17a1bc380 -1 librbd: Forced V1 image creation. 2023-12-06T15:28:25.956 INFO:tasks.workunit.client.0.smithi123.stderr: Thick provisioning: 6% complete... Thick provisioning: 12% complete... Thick provisioning: 18% complete... Thick provisioning: 25% complete... Thick provisioning: 31% complete... Thick provisioning: 37% complete... Thick provisioning: 43% complete... Thick provisioning: 50% complete... Thick provisioning: 56% complete... Thick provisioning: 62% complete... Thick provisioning: 68% complete... Thick provisioning: 75% complete... Thick provisioning: 81% complete... Thick provisioning: 87% complete... Thick provisioning: 93% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2023-12-06T15:28:25.962 INFO:tasks.workunit.client.0.smithi123.stderr:+ count=0 2023-12-06T15:28:25.963 INFO:tasks.workunit.client.0.smithi123.stderr:+ ret= 2023-12-06T15:28:25.963 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 0 -lt 10 ']' 2023-12-06T15:28:25.963 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd du 2023-12-06T15:28:25.963 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep test1 2023-12-06T15:28:25.963 INFO:tasks.workunit.client.0.smithi123.stderr:+ tr -s ' ' 2023-12-06T15:28:25.963 INFO:tasks.workunit.client.0.smithi123.stderr:+ cut -d ' ' -f 4-5 2023-12-06T15:28:25.965 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^64 MiB' 2023-12-06T15:28:25.990 INFO:tasks.workunit.client.0.smithi123.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2023-12-06T15:28:25.994 INFO:tasks.workunit.client.0.smithi123.stdout:64 MiB 2023-12-06T15:28:25.995 INFO:tasks.workunit.client.0.smithi123.stderr:+ ret=0 2023-12-06T15:28:25.995 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 0 = 0 ']' 2023-12-06T15:28:25.995 INFO:tasks.workunit.client.0.smithi123.stderr:+ break 2023-12-06T15:28:25.995 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd du 2023-12-06T15:28:26.021 INFO:tasks.workunit.client.0.smithi123.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2023-12-06T15:28:26.023 INFO:tasks.workunit.client.0.smithi123.stdout:NAME PROVISIONED USED 2023-12-06T15:28:26.023 INFO:tasks.workunit.client.0.smithi123.stdout:test1 64 MiB 64 MiB 2023-12-06T15:28:26.025 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 0 '!=' 0 ']' 2023-12-06T15:28:26.026 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test1 2023-12-06T15:28:26.294 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 6% complete... Removing image: 12% complete... Removing image: 18% complete... Removing image: 25% complete... Removing image: 31% complete... Removing image: 37% complete... Removing image: 43% complete... Removing image: 50% complete... Removing image: 56% complete... Removing image: 62% complete... Removing image: 68% complete... Removing image: 75% complete... Removing image: 81% complete... Removing image: 87% complete... Removing image: 93% complete... Removing image: 100% complete...done. 2023-12-06T15:28:26.297 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep test1 2023-12-06T15:28:26.297 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:28:26.297 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^0$' 2023-12-06T15:28:26.297 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:28:26.327 INFO:tasks.workunit.client.0.smithi123.stdout:0 2023-12-06T15:28:26.327 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --thick-provision -s 4G test1 2023-12-06T15:28:26.353 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:28:26.353+0000 7f31f130a380 -1 librbd: Forced V1 image creation. 2023-12-06T15:28:27.277 INFO:tasks.workunit.client.0.smithi123.stderr: Thick provisioning: 1% complete... Thick provisioning: 2% complete... Thick provisioning: 3% complete... Thick provisioning: 4% complete... Thick provisioning: 5% complete... Thick provisioning: 6% complete... Thick provisioning: 7% complete... Thick provisioning: 8% complete... Thick provisioning: 9% complete... Thick provisioning: 10% complete... Thick provisioning: 11% complete...2023-12-06T15:28:27.277+0000 7f31e111e700 0 -- 172.21.15.123:0/342340051 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x55be067dd7b0 msgr2=0x55be067d49c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:28:27.492 INFO:tasks.workunit.client.0.smithi123.stderr: Thick provisioning: 12% complete... Thick provisioning: 13% complete...2023-12-06T15:28:27.492+0000 7f31e111e700 0 -- 172.21.15.123:0/342340051 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7f31c4036570 msgr2=0x7f31c40389a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:28:35.734 INFO:tasks.workunit.client.0.smithi123.stderr: Thick provisioning: 14% complete... Thick provisioning: 15% complete... Thick provisioning: 16% complete... Thick provisioning: 17% complete... Thick provisioning: 18% complete... Thick provisioning: 19% complete... Thick provisioning: 20% complete... Thick provisioning: 21% complete... Thick provisioning: 22% complete... Thick provisioning: 23% complete... Thick provisioning: 24% complete... Thick provisioning: 25% complete... Thick provisioning: 26% complete... Thick provisioning: 27% complete... Thick provisioning: 28% complete... Thick provisioning: 29% complete... Thick provisioning: 30% complete... Thick provisioning: 31% complete... Thick provisioning: 32% complete... Thick provisioning: 33% complete... Thick provisioning: 34% complete... Thick provisioning: 35% complete... Thick provisioning: 36% complete... Thick provisioning: 37% complete... Thick provisioning: 38% complete... Thick provisioning: 39% complete... Thick provisioning: 40% complete... Thick provisioning: 41% complete... Thick provisioning: 42% complete... Thick provisioning: 43% complete... Thick provisioning: 44% complete... Thick provisioning: 45% complete... Thick provisioning: 46% complete... Thick provisioning: 47% complete... Thick provisioning: 48% complete... Thick provisioning: 49% complete... Thick provisioning: 50% complete... Thick provisioning: 51% complete... Thick provisioning: 52% complete... Thick provisioning: 53% complete... Thick provisioning: 54% complete... Thick provisioning: 55% complete... Thick provisioning: 56% complete... Thick provisioning: 57% complete... Thick provisioning: 58% complete... Thick provisioning: 59% complete... Thick provisioning: 60% complete... Thick provisioning: 61% complete... Thick provisioning: 62% complete... Thick provisioning: 63% complete... Thick provisioning: 64% complete... Thick provisioning: 65% complete... Thick provisioning: 66% complete... Thick provisioning: 67% complete... Thick provisioning: 68% complete... Thick provisioning: 69% complete... Thick provisioning: 70% complete... Thick provisioning: 71% complete... Thick provisioning: 72% complete... Thick provisioning: 73% complete... Thick provisioning: 74% complete... Thick provisioning: 75% complete... Thick provisioning: 76% complete... Thick provisioning: 77% complete... Thick provisioning: 78% complete... Thick provisioning: 79% complete... Thick provisioning: 80% complete... Thick provisioning: 81% complete... Thick provisioning: 82% complete... Thick provisioning: 83% complete... Thick provisioning: 84% complete... Thick provisioning: 85% complete... Thick provisioning: 86% complete... Thick provisioning: 87% complete... Thick provisioning: 88% complete... Thick provisioning: 89% complete... Thick provisioning: 90% complete... Thick provisioning: 91% complete... Thick provisioning: 92% complete... Thick provisioning: 93% complete... Thick provisioning: 94% complete... Thick provisioning: 95% complete... Thick provisioning: 96% complete... Thick provisioning: 97% complete... Thick provisioning: 98% complete... Thick provisioning: 99% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2023-12-06T15:28:35.739 INFO:tasks.workunit.client.0.smithi123.stderr:+ count=0 2023-12-06T15:28:35.739 INFO:tasks.workunit.client.0.smithi123.stderr:+ ret= 2023-12-06T15:28:35.739 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 0 -lt 10 ']' 2023-12-06T15:28:35.739 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd du 2023-12-06T15:28:35.739 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep test1 2023-12-06T15:28:35.739 INFO:tasks.workunit.client.0.smithi123.stderr:+ tr -s ' ' 2023-12-06T15:28:35.739 INFO:tasks.workunit.client.0.smithi123.stderr:+ cut -d ' ' -f 4-5 2023-12-06T15:28:35.739 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^4 GiB' 2023-12-06T15:28:35.766 INFO:tasks.workunit.client.0.smithi123.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2023-12-06T15:28:35.777 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:28:35.778+0000 7fb112f68700 0 -- 172.21.15.123:0/968867117 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x5633fda42bf0 msgr2=0x5633fda52b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:28:35.780 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:28:35.781+0000 7fb112767700 0 -- 172.21.15.123:0/968867117 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x5633fda55ca0 msgr2=0x5633fda58090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:28:35.927 INFO:tasks.workunit.client.0.smithi123.stdout:4 GiB 2023-12-06T15:28:35.928 INFO:tasks.workunit.client.0.smithi123.stderr:+ ret=0 2023-12-06T15:28:35.928 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 0 = 0 ']' 2023-12-06T15:28:35.928 INFO:tasks.workunit.client.0.smithi123.stderr:+ break 2023-12-06T15:28:35.929 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd du 2023-12-06T15:28:35.955 INFO:tasks.workunit.client.0.smithi123.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2023-12-06T15:28:35.966 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:28:35.966+0000 7fe979d55700 0 -- 172.21.15.123:0/542765252 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x5582f8a8cd00 msgr2=0x5582f8a78110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:28:35.969 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:28:35.969+0000 7fe979d55700 0 -- 172.21.15.123:0/542765252 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7fe95c038ff0 msgr2=0x7fe95c03b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:28:36.113 INFO:tasks.workunit.client.0.smithi123.stdout:NAME PROVISIONED USED 2023-12-06T15:28:36.114 INFO:tasks.workunit.client.0.smithi123.stdout:test1 4 GiB 4 GiB 2023-12-06T15:28:36.114 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 0 '!=' 0 ']' 2023-12-06T15:28:36.114 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test1 2023-12-06T15:28:36.235 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete...2023-12-06T15:28:36.236+0000 7fb9e9af1700 0 -- 172.21.15.123:0/4154730097 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x55dd55f7f600 msgr2=0x55dd56020050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T15:28:36.255 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 11% complete... Removing image: 12% complete...2023-12-06T15:28:36.255+0000 7fb9e92f0700 0 -- 172.21.15.123:0/4154730097 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x55dd56020e00 msgr2=0x55dd560231f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:28:37.039 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2023-12-06T15:28:37.042 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:28:37.042 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep test1 2023-12-06T15:28:37.042 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:28:37.042 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^0$' 2023-12-06T15:28:37.067 INFO:tasks.workunit.client.0.smithi123.stdout:0 2023-12-06T15:28:37.068 INFO:tasks.workunit.client.0.smithi123.stderr:+ RBD_CREATE_ARGS='--image-format 2' 2023-12-06T15:28:37.068 INFO:tasks.workunit.client.0.smithi123.stderr:+ test_others 2023-12-06T15:28:37.068 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 'testing import, export, resize, and snapshots...' 2023-12-06T15:28:37.068 INFO:tasks.workunit.client.0.smithi123.stdout:testing import, export, resize, and snapshots... 2023-12-06T15:28:37.069 INFO:tasks.workunit.client.0.smithi123.stderr:+ TMP_FILES='/tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1' 2023-12-06T15:28:37.069 INFO:tasks.workunit.client.0.smithi123.stderr:+ remove_images 2023-12-06T15:28:37.069 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:37.142 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:37.216 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:37.290 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:37.364 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:37.439 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:37.512 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:37.585 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:37.659 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:37.733 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:37.806 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:37.879 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:37.952 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:38.025 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:38.098 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:38.172 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:38.247 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:38.322 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:38.397 INFO:tasks.workunit.client.0.smithi123.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2023-12-06T15:28:38.398 INFO:tasks.workunit.client.0.smithi123.stderr:+ dd if=/bin/sh of=/tmp/img1 bs=1k count=1 seek=10 2023-12-06T15:28:38.399 INFO:tasks.workunit.client.0.smithi123.stderr:1+0 records in 2023-12-06T15:28:38.399 INFO:tasks.workunit.client.0.smithi123.stderr:1+0 records out 2023-12-06T15:28:38.399 INFO:tasks.workunit.client.0.smithi123.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 3.8877e-05 s, 26.3 MB/s 2023-12-06T15:28:38.399 INFO:tasks.workunit.client.0.smithi123.stderr:+ dd if=/bin/dd of=/tmp/img1 bs=1k count=10 seek=100 2023-12-06T15:28:38.399 INFO:tasks.workunit.client.0.smithi123.stderr:10+0 records in 2023-12-06T15:28:38.399 INFO:tasks.workunit.client.0.smithi123.stderr:10+0 records out 2023-12-06T15:28:38.400 INFO:tasks.workunit.client.0.smithi123.stderr:10240 bytes (10 kB, 10 KiB) copied, 5.0371e-05 s, 203 MB/s 2023-12-06T15:28:38.400 INFO:tasks.workunit.client.0.smithi123.stderr:+ dd if=/bin/rm of=/tmp/img1 bs=1k count=100 seek=1000 2023-12-06T15:28:38.400 INFO:tasks.workunit.client.0.smithi123.stderr:70+1 records in 2023-12-06T15:28:38.400 INFO:tasks.workunit.client.0.smithi123.stderr:70+1 records out 2023-12-06T15:28:38.400 INFO:tasks.workunit.client.0.smithi123.stderr:72208 bytes (72 kB, 71 KiB) copied, 0.000177229 s, 407 MB/s 2023-12-06T15:28:38.400 INFO:tasks.workunit.client.0.smithi123.stderr:+ dd if=/bin/ls of=/tmp/img1 bs=1k seek=10000 2023-12-06T15:28:38.401 INFO:tasks.workunit.client.0.smithi123.stderr:140+1 records in 2023-12-06T15:28:38.401 INFO:tasks.workunit.client.0.smithi123.stderr:140+1 records out 2023-12-06T15:28:38.401 INFO:tasks.workunit.client.0.smithi123.stderr:143376 bytes (143 kB, 140 KiB) copied, 0.00030021 s, 478 MB/s 2023-12-06T15:28:38.401 INFO:tasks.workunit.client.0.smithi123.stderr:+ dd if=/bin/ln of=/tmp/img1 bs=1k seek=100000 2023-12-06T15:28:38.402 INFO:tasks.workunit.client.0.smithi123.stderr:70+1 records in 2023-12-06T15:28:38.402 INFO:tasks.workunit.client.0.smithi123.stderr:70+1 records out 2023-12-06T15:28:38.402 INFO:tasks.workunit.client.0.smithi123.stderr:72312 bytes (72 kB, 71 KiB) copied, 0.000175249 s, 413 MB/s 2023-12-06T15:28:38.402 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd import --image-format 2 /tmp/img1 testimg1 2023-12-06T15:28:38.519 INFO:tasks.workunit.client.0.smithi123.stderr: Importing image: 4% complete... Importing image: 8% complete... Importing image: 12% complete... Importing image: 16% complete... Importing image: 20% complete... Importing image: 24% complete... Importing image: 28% complete... Importing image: 32% complete... Importing image: 36% complete... Importing image: 40% complete... Importing image: 45% complete... Importing image: 49% complete... Importing image: 53% complete... Importing image: 57% complete... Importing image: 61% complete... Importing image: 65% complete... Importing image: 69% complete... Importing image: 73% complete... Importing image: 77% complete... Importing image: 81% complete... Importing image: 85% complete... Importing image: 90% complete... Importing image: 94% complete... Importing image: 98% complete... Importing image: 100% complete...done. 2023-12-06T15:28:38.521 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd resize testimg1 --size=256 --allow-shrink 2023-12-06T15:28:38.562 INFO:tasks.workunit.client.0.smithi123.stderr: Resizing image: 100% complete...done. 2023-12-06T15:28:38.568 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd export testimg1 /tmp/img2 2023-12-06T15:28:38.664 INFO:tasks.workunit.client.0.smithi123.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-12-06T15:28:38.667 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create testimg1 --snap=snap1 2023-12-06T15:28:39.357 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:28:39.367 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd resize testimg1 --size=128 2023-12-06T15:28:39.404 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: shrinking an image is only allowed with the --allow-shrink flag 2023-12-06T15:28:39.409 INFO:tasks.workunit.client.0.smithi123.stderr:+ true 2023-12-06T15:28:39.409 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd resize testimg1 --size=128 --allow-shrink 2023-12-06T15:28:39.453 INFO:tasks.workunit.client.0.smithi123.stderr: Resizing image: 50% complete... Resizing image: 51% complete... Resizing image: 53% complete... Resizing image: 54% complete... Resizing image: 56% complete... Resizing image: 57% complete... Resizing image: 59% complete... Resizing image: 60% complete... Resizing image: 62% complete... Resizing image: 64% complete... Resizing image: 65% complete... Resizing image: 67% complete... Resizing image: 68% complete... Resizing image: 70% complete... Resizing image: 71% complete... Resizing image: 73% complete... Resizing image: 75% complete... Resizing image: 76% complete... Resizing image: 78% complete... Resizing image: 79% complete... Resizing image: 81% complete... Resizing image: 82% complete... Resizing image: 84% complete... Resizing image: 85% complete... Resizing image: 87% complete... Resizing image: 89% complete... Resizing image: 90% complete... Resizing image: 92% complete... Resizing image: 93% complete... Resizing image: 95% complete... Resizing image: 96% complete... Resizing image: 98% complete... Resizing image: 100% complete...done. 2023-12-06T15:28:39.460 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd export testimg1 /tmp/img3 2023-12-06T15:28:39.531 INFO:tasks.workunit.client.0.smithi123.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-12-06T15:28:39.535 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info testimg1 2023-12-06T15:28:39.535 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'size 128 MiB' 2023-12-06T15:28:39.567 INFO:tasks.workunit.client.0.smithi123.stdout: size 128 MiB in 32 objects 2023-12-06T15:28:39.568 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info --snap=snap1 testimg1 2023-12-06T15:28:39.568 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'size 256 MiB' 2023-12-06T15:28:39.603 INFO:tasks.workunit.client.0.smithi123.stdout: size 256 MiB in 64 objects 2023-12-06T15:28:39.603 INFO:tasks.workunit.client.0.smithi123.stderr:+ rm -rf /tmp/diff-testimg1-1 /tmp/diff-testimg1-2 2023-12-06T15:28:39.604 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd export-diff testimg1 --snap=snap1 /tmp/diff-testimg1-1 2023-12-06T15:28:39.655 INFO:tasks.workunit.client.0.smithi123.stderr: Exporting image: 3% complete... Exporting image: 37% complete... Exporting image: 100% complete...done. 2023-12-06T15:28:39.658 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd export-diff testimg1 --from-snap=snap1 /tmp/diff-testimg1-2 2023-12-06T15:28:39.695 INFO:tasks.workunit.client.0.smithi123.stderr: Exporting image: 100% complete...done. 2023-12-06T15:28:39.698 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 --size=1 testimg-diff1 2023-12-06T15:28:39.737 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-1 testimg-diff1 2023-12-06T15:28:40.360 INFO:tasks.workunit.client.0.smithi123.stderr: Importing image diff: 22% complete... Importing image diff: 63% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2023-12-06T15:28:40.368 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-2 testimg-diff1 2023-12-06T15:28:40.413 INFO:tasks.workunit.client.0.smithi123.stderr: Importing image diff: 68% complete... Importing image diff: 96% complete... Importing image diff: 100% complete...done. 2023-12-06T15:28:40.421 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info testimg1 2023-12-06T15:28:40.421 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'size 128 MiB' 2023-12-06T15:28:40.454 INFO:tasks.workunit.client.0.smithi123.stdout: size 128 MiB in 32 objects 2023-12-06T15:28:40.455 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info --snap=snap1 testimg1 2023-12-06T15:28:40.455 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'size 256 MiB' 2023-12-06T15:28:40.489 INFO:tasks.workunit.client.0.smithi123.stdout: size 256 MiB in 64 objects 2023-12-06T15:28:40.489 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info testimg-diff1 2023-12-06T15:28:40.489 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'size 128 MiB' 2023-12-06T15:28:40.522 INFO:tasks.workunit.client.0.smithi123.stdout: size 128 MiB in 32 objects 2023-12-06T15:28:40.522 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info --snap=snap1 testimg-diff1 2023-12-06T15:28:40.522 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'size 256 MiB' 2023-12-06T15:28:40.558 INFO:tasks.workunit.client.0.smithi123.stdout: size 256 MiB in 64 objects 2023-12-06T15:28:40.558 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd copy testimg1 --snap=snap1 testimg2 2023-12-06T15:28:40.644 INFO:tasks.workunit.client.0.smithi123.stderr: Image copy: 3% complete... Image copy: 37% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-12-06T15:28:40.647 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd copy testimg1 testimg3 2023-12-06T15:28:40.740 INFO:tasks.workunit.client.0.smithi123.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-12-06T15:28:40.743 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd copy testimg-diff1 --sparse-size 768K --snap=snap1 testimg-diff2 2023-12-06T15:28:40.835 INFO:tasks.workunit.client.0.smithi123.stderr: Image copy: 3% complete... Image copy: 37% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-12-06T15:28:40.836 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd copy testimg-diff1 --sparse-size 768K testimg-diff3 2023-12-06T15:28:40.945 INFO:tasks.workunit.client.0.smithi123.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-12-06T15:28:40.948 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info testimg2 2023-12-06T15:28:40.948 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'size 256 MiB' 2023-12-06T15:28:40.979 INFO:tasks.workunit.client.0.smithi123.stdout: size 256 MiB in 64 objects 2023-12-06T15:28:40.980 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info testimg3 2023-12-06T15:28:40.980 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'size 128 MiB' 2023-12-06T15:28:41.011 INFO:tasks.workunit.client.0.smithi123.stdout: size 128 MiB in 32 objects 2023-12-06T15:28:41.012 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info testimg-diff2 2023-12-06T15:28:41.012 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'size 256 MiB' 2023-12-06T15:28:41.044 INFO:tasks.workunit.client.0.smithi123.stdout: size 256 MiB in 64 objects 2023-12-06T15:28:41.044 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info testimg-diff3 2023-12-06T15:28:41.045 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'size 128 MiB' 2023-12-06T15:28:41.075 INFO:tasks.workunit.client.0.smithi123.stdout: size 128 MiB in 32 objects 2023-12-06T15:28:41.076 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd deep copy testimg1 testimg4 2023-12-06T15:28:41.397 INFO:tasks.workunit.client.0.smithi123.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-12-06T15:28:41.400 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd deep copy testimg1 --snap=snap1 testimg5 2023-12-06T15:28:42.410 INFO:tasks.workunit.client.0.smithi123.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-12-06T15:28:42.413 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info testimg4 2023-12-06T15:28:42.413 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'size 128 MiB' 2023-12-06T15:28:42.446 INFO:tasks.workunit.client.0.smithi123.stdout: size 128 MiB in 32 objects 2023-12-06T15:28:42.447 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info testimg5 2023-12-06T15:28:42.447 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'size 256 MiB' 2023-12-06T15:28:42.482 INFO:tasks.workunit.client.0.smithi123.stdout: size 256 MiB in 64 objects 2023-12-06T15:28:42.482 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap ls testimg4 2023-12-06T15:28:42.482 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -v SNAPID 2023-12-06T15:28:42.482 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:28:42.483 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 1 2023-12-06T15:28:42.512 INFO:tasks.workunit.client.0.smithi123.stdout:1 2023-12-06T15:28:42.513 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap ls testimg4 2023-12-06T15:28:42.513 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '.*snap1.*' 2023-12-06T15:28:42.546 INFO:tasks.workunit.client.0.smithi123.stdout: 26 snap1 256 MiB Wed Dec 6 15:28:41 2023 2023-12-06T15:28:42.546 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd export testimg1 /tmp/img1.new 2023-12-06T15:28:42.618 INFO:tasks.workunit.client.0.smithi123.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-12-06T15:28:42.621 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd export testimg2 /tmp/img2.new 2023-12-06T15:28:42.718 INFO:tasks.workunit.client.0.smithi123.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-12-06T15:28:42.722 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd export testimg3 /tmp/img3.new 2023-12-06T15:28:42.794 INFO:tasks.workunit.client.0.smithi123.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-12-06T15:28:42.797 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.new 2023-12-06T15:28:42.873 INFO:tasks.workunit.client.0.smithi123.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-12-06T15:28:42.876 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd export testimg-diff2 /tmp/img-diff2.new 2023-12-06T15:28:42.981 INFO:tasks.workunit.client.0.smithi123.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-12-06T15:28:42.984 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd export testimg-diff3 /tmp/img-diff3.new 2023-12-06T15:28:43.052 INFO:tasks.workunit.client.0.smithi123.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-12-06T15:28:43.055 INFO:tasks.workunit.client.0.smithi123.stderr:+ cmp /tmp/img2 /tmp/img2.new 2023-12-06T15:28:43.248 INFO:tasks.workunit.client.0.smithi123.stderr:+ cmp /tmp/img3 /tmp/img3.new 2023-12-06T15:28:43.341 INFO:tasks.workunit.client.0.smithi123.stderr:+ cmp /tmp/img2 /tmp/img-diff2.new 2023-12-06T15:28:43.496 INFO:tasks.workunit.client.0.smithi123.stderr:+ cmp /tmp/img3 /tmp/img-diff3.new 2023-12-06T15:28:43.574 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap rollback --snap=snap1 testimg1 2023-12-06T15:28:44.200 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:28:44.200+0000 7f455e68d700 0 --2- 172.21.15.123:0/2002789894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561a068bd040 0x561a069464c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-12-06T15:28:44.279 INFO:tasks.workunit.client.0.smithi123.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2023-12-06T15:28:44.291 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap rollback --snap=snap1 testimg-diff1 2023-12-06T15:28:44.401 INFO:tasks.workunit.client.0.smithi123.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2023-12-06T15:28:44.409 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info testimg1 2023-12-06T15:28:44.409 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'size 256 MiB' 2023-12-06T15:28:44.441 INFO:tasks.workunit.client.0.smithi123.stdout: size 256 MiB in 64 objects 2023-12-06T15:28:44.441 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info testimg-diff1 2023-12-06T15:28:44.442 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'size 256 MiB' 2023-12-06T15:28:44.475 INFO:tasks.workunit.client.0.smithi123.stdout: size 256 MiB in 64 objects 2023-12-06T15:28:44.475 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd export testimg1 /tmp/img1.snap1 2023-12-06T15:28:44.583 INFO:tasks.workunit.client.0.smithi123.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-12-06T15:28:44.585 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.snap1 2023-12-06T15:28:44.690 INFO:tasks.workunit.client.0.smithi123.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-12-06T15:28:44.693 INFO:tasks.workunit.client.0.smithi123.stderr:+ cmp /tmp/img2 /tmp/img1.snap1 2023-12-06T15:28:44.843 INFO:tasks.workunit.client.0.smithi123.stderr:+ cmp /tmp/img2 /tmp/img-diff1.snap1 2023-12-06T15:28:44.989 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm testimg2 2023-12-06T15:28:45.094 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete...2023-12-06T15:28:45.094+0000 7f35b4c9d700 0 -- 172.21.15.123:0/625054006 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x55bc1d1a04d0 msgr2=0x55bc1d245180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T15:28:45.098 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:28:45.101 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm testimg3 2023-12-06T15:28:45.191 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-12-06T15:28:45.192+0000 7fc981633700 0 -- 172.21.15.123:0/229113110 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x564037c47c80 msgr2=0x564037cecf50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T15:28:45.196 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:28:45.198 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create testimg2 -s 0 2023-12-06T15:28:45.224 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:28:45.225+0000 7f17f488a380 -1 librbd: Forced V1 image creation. 2023-12-06T15:28:45.231 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd cp testimg2 testimg3 2023-12-06T15:28:45.480 INFO:tasks.workunit.client.0.smithi123.stderr: Image copy: 100% complete...done. 2023-12-06T15:28:45.482 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd deep cp testimg2 testimg6 2023-12-06T15:28:45.530 INFO:tasks.workunit.client.0.smithi123.stderr: Image deep copy: 100% complete...done. 2023-12-06T15:28:45.533 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap rm --snap=snap1 testimg1 2023-12-06T15:28:46.372 INFO:tasks.workunit.client.0.smithi123.stderr: Removing snap: 100% complete...done. 2023-12-06T15:28:46.381 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap rm --snap=snap1 testimg-diff1 2023-12-06T15:28:47.376 INFO:tasks.workunit.client.0.smithi123.stderr: Removing snap: 100% complete...done. 2023-12-06T15:28:47.385 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info --snap=snap1 testimg1 2023-12-06T15:28:47.385 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2023-12-06T15:28:47.422 INFO:tasks.workunit.client.0.smithi123.stdout:error setting snapshot context: (2) No such file or directory 2023-12-06T15:28:47.422 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info --snap=snap1 testimg-diff1 2023-12-06T15:28:47.422 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2023-12-06T15:28:47.456 INFO:tasks.workunit.client.0.smithi123.stdout:error setting snapshot context: (2) No such file or directory 2023-12-06T15:28:47.457 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd sparsify testimg1 2023-12-06T15:28:47.511 INFO:tasks.workunit.client.0.smithi123.stderr: Image sparsify: 1% complete... Image sparsify: 3% complete... Image sparsify: 4% complete... Image sparsify: 6% complete... Image sparsify: 7% complete... Image sparsify: 9% complete... Image sparsify: 10% complete... Image sparsify: 12% complete... Image sparsify: 14% complete... Image sparsify: 15% complete... Image sparsify: 17% complete... Image sparsify: 18% complete... Image sparsify: 20% complete... Image sparsify: 21% complete... Image sparsify: 23% complete... Image sparsify: 25% complete... Image sparsify: 26% complete... Image sparsify: 28% complete... Image sparsify: 29% complete... Image sparsify: 31% complete... Image sparsify: 32% complete... Image sparsify: 34% complete... Image sparsify: 35% complete... Image sparsify: 37% complete... Image sparsify: 39% complete... Image sparsify: 40% complete... Image sparsify: 42% complete... Image sparsify: 43% complete... Image sparsify: 45% complete... Image sparsify: 46% complete... Image sparsify: 48% complete... Image sparsify: 50% complete... Image sparsify: 51% complete... Image sparsify: 53% complete... Image sparsify: 54% complete... Image sparsify: 56% complete... Image sparsify: 57% complete... Image sparsify: 59% complete... Image sparsify: 60% complete... Image sparsify: 62% complete... Image sparsify: 64% complete... Image sparsify: 65% complete... Image sparsify: 67% complete... Image sparsify: 68% complete... Image sparsify: 70% complete... Image sparsify: 71% complete... Image sparsify: 73% complete... Image sparsify: 75% complete... Image sparsify: 76% complete... Image sparsify: 78% complete... Image sparsify: 79% complete... Image sparsify: 81% complete... Image sparsify: 82% complete... Image sparsify: 84% complete... Image sparsify: 85% complete... Image sparsify: 87% complete... Image sparsify: 89% complete... Image sparsify: 90% complete... Image sparsify: 92% complete... Image sparsify: 93% complete... Image sparsify: 95% complete... Image sparsify: 96% complete... Image sparsify: 98% complete... Image sparsify: 100% complete...done. 2023-12-06T15:28:47.518 INFO:tasks.workunit.client.0.smithi123.stderr:+ remove_images 2023-12-06T15:28:47.518 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:47.662 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:47.735 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:47.846 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:48.501 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:49.521 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:49.638 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:49.780 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:49.923 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:50.063 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:50.139 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:50.216 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:50.292 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:50.367 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:50.442 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:50.518 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:50.595 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:50.673 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:50.749 INFO:tasks.workunit.client.0.smithi123.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2023-12-06T15:28:50.854 INFO:tasks.workunit.client.0.smithi123.stderr:+ test_locking 2023-12-06T15:28:50.854 INFO:tasks.workunit.client.0.smithi123.stdout:testing locking... 2023-12-06T15:28:50.854 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 'testing locking...' 2023-12-06T15:28:50.854 INFO:tasks.workunit.client.0.smithi123.stderr:+ remove_images 2023-12-06T15:28:50.854 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:50.929 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:51.003 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:51.077 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:51.152 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:51.430 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:51.503 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:51.578 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:51.654 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:51.729 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:51.806 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:51.879 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:51.954 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:52.028 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:52.103 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:52.378 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:52.454 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:52.529 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:52.606 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 -s 1 test1 2023-12-06T15:28:52.648 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd lock list test1 2023-12-06T15:28:52.648 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:28:52.648 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^0$' 2023-12-06T15:28:52.680 INFO:tasks.workunit.client.0.smithi123.stdout:0 2023-12-06T15:28:52.680 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd lock add test1 id 2023-12-06T15:28:52.721 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd lock list test1 2023-12-06T15:28:52.721 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep ' 1 ' 2023-12-06T15:28:52.754 INFO:tasks.workunit.client.0.smithi123.stdout:There is 1 exclusive lock on this image. 2023-12-06T15:28:52.755 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd lock list test1 2023-12-06T15:28:52.755 INFO:tasks.workunit.client.0.smithi123.stderr:++ tail -n 1 2023-12-06T15:28:52.755 INFO:tasks.workunit.client.0.smithi123.stderr:++ awk '{print $1;}' 2023-12-06T15:28:52.788 INFO:tasks.workunit.client.0.smithi123.stderr:+ LOCKER=client.8444 2023-12-06T15:28:52.788 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd lock remove test1 id client.8444 2023-12-06T15:28:53.391 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd lock list test1 2023-12-06T15:28:53.391 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:28:53.391 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^0$' 2023-12-06T15:28:53.425 INFO:tasks.workunit.client.0.smithi123.stdout:0 2023-12-06T15:28:53.426 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd lock add test1 id --shared tag 2023-12-06T15:28:53.467 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd lock list test1 2023-12-06T15:28:53.468 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep ' 1 ' 2023-12-06T15:28:53.500 INFO:tasks.workunit.client.0.smithi123.stdout:There is 1 shared lock on this image. 2023-12-06T15:28:53.500 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd lock add test1 id --shared tag 2023-12-06T15:28:53.541 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd lock list test1 2023-12-06T15:28:53.542 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep ' 2 ' 2023-12-06T15:28:53.573 INFO:tasks.workunit.client.0.smithi123.stdout:There are 2 shared locks on this image. 2023-12-06T15:28:53.574 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd lock add test1 id2 --shared tag 2023-12-06T15:28:53.614 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd lock list test1 2023-12-06T15:28:53.614 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep ' 3 ' 2023-12-06T15:28:53.646 INFO:tasks.workunit.client.0.smithi123.stdout:There are 3 shared locks on this image. 2023-12-06T15:28:53.647 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd lock list test1 2023-12-06T15:28:53.647 INFO:tasks.workunit.client.0.smithi123.stderr:+ tail -n 1 2023-12-06T15:28:53.647 INFO:tasks.workunit.client.0.smithi123.stderr:+ awk '{print $2, $1;}' 2023-12-06T15:28:53.647 INFO:tasks.workunit.client.0.smithi123.stderr:+ xargs rbd lock remove test1 2023-12-06T15:28:54.393 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info test1 2023-12-06T15:28:54.393 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -qE 'features:.*exclusive' 2023-12-06T15:28:54.431 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd lock list test1 2023-12-06T15:28:54.466 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' -n 'There are 2 shared locks on this image. 2023-12-06T15:28:54.466 INFO:tasks.workunit.client.0.smithi123.stderr:Lock tag: tag 2023-12-06T15:28:54.466 INFO:tasks.workunit.client.0.smithi123.stderr:Locker ID Address 2023-12-06T15:28:54.467 INFO:tasks.workunit.client.0.smithi123.stderr:client.8459 id 172.21.15.123:0/1158062943 2023-12-06T15:28:54.467 INFO:tasks.workunit.client.0.smithi123.stderr:client.8465 id 172.21.15.123:0/4067929358' ']' 2023-12-06T15:28:54.467 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd lock list test1 2023-12-06T15:28:54.467 INFO:tasks.workunit.client.0.smithi123.stderr:+ tail -n 1 2023-12-06T15:28:54.467 INFO:tasks.workunit.client.0.smithi123.stderr:+ awk '{print $2, $1;}' 2023-12-06T15:28:54.467 INFO:tasks.workunit.client.0.smithi123.stderr:+ xargs rbd lock remove test1 2023-12-06T15:28:55.397 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd lock list test1 2023-12-06T15:28:55.433 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' -n 'There is 1 shared lock on this image. 2023-12-06T15:28:55.433 INFO:tasks.workunit.client.0.smithi123.stderr:Lock tag: tag 2023-12-06T15:28:55.433 INFO:tasks.workunit.client.0.smithi123.stderr:Locker ID Address 2023-12-06T15:28:55.433 INFO:tasks.workunit.client.0.smithi123.stderr:client.8459 id 172.21.15.123:0/1158062943' ']' 2023-12-06T15:28:55.433 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd lock list test1 2023-12-06T15:28:55.434 INFO:tasks.workunit.client.0.smithi123.stderr:+ tail -n 1 2023-12-06T15:28:55.434 INFO:tasks.workunit.client.0.smithi123.stderr:+ awk '{print $2, $1;}' 2023-12-06T15:28:55.434 INFO:tasks.workunit.client.0.smithi123.stderr:+ xargs rbd lock remove test1 2023-12-06T15:28:56.405 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd lock list test1 2023-12-06T15:28:56.443 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' -n '' ']' 2023-12-06T15:28:56.444 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test1 2023-12-06T15:28:56.549 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:28:56.551 INFO:tasks.workunit.client.0.smithi123.stderr:+ test_clone 2023-12-06T15:28:56.551 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 'testing clone...' 2023-12-06T15:28:56.552 INFO:tasks.workunit.client.0.smithi123.stdout:testing clone... 2023-12-06T15:28:56.552 INFO:tasks.workunit.client.0.smithi123.stderr:+ remove_images 2023-12-06T15:28:56.552 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:56.627 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:56.702 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:56.775 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:56.850 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:56.925 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:56.998 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:57.073 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:57.148 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:57.222 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:57.297 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:57.371 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:57.446 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:57.520 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:57.594 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:57.668 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:57.743 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:57.819 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:28:57.894 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create test1 --image-format 2 -s 1 2023-12-06T15:28:57.935 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create test1@s1 2023-12-06T15:28:58.237 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:28:58.247 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap protect test1@s1 2023-12-06T15:28:58.285 INFO:tasks.workunit.client.0.smithi123.stderr:+ ceph osd pool create rbd2 8 2023-12-06T15:28:59.515 INFO:tasks.workunit.client.0.smithi123.stderr:pool 'rbd2' already exists 2023-12-06T15:28:59.524 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd pool init rbd2 2023-12-06T15:29:02.417 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd clone test1@s1 rbd2/clone 2023-12-06T15:29:02.480 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd -p rbd2 ls 2023-12-06T15:29:02.480 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep clone 2023-12-06T15:29:02.508 INFO:tasks.workunit.client.0.smithi123.stdout:clone 2023-12-06T15:29:02.508 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd -p rbd2 ls -l 2023-12-06T15:29:02.509 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep clone 2023-12-06T15:29:02.509 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep test1@s1 2023-12-06T15:29:02.550 INFO:tasks.workunit.client.0.smithi123.stdout:clone 1 MiB rbd/test1@s1 2 2023-12-06T15:29:02.551 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:29:02.551 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -v clone 2023-12-06T15:29:02.577 INFO:tasks.workunit.client.0.smithi123.stdout:test1 2023-12-06T15:29:02.577 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd flatten rbd2/clone 2023-12-06T15:29:02.617 INFO:tasks.workunit.client.0.smithi123.stderr: Image flatten: 100% complete...done. 2023-12-06T15:29:02.623 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create rbd2/clone@s1 2023-12-06T15:29:03.420 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:29:03.428 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap protect rbd2/clone@s1 2023-12-06T15:29:03.473 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd clone rbd2/clone@s1 clone2 2023-12-06T15:29:03.545 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:29:03.546 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep clone2 2023-12-06T15:29:03.572 INFO:tasks.workunit.client.0.smithi123.stdout:clone2 2023-12-06T15:29:03.573 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls -l 2023-12-06T15:29:03.573 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep clone2 2023-12-06T15:29:03.573 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep rbd2/clone@s1 2023-12-06T15:29:03.613 INFO:tasks.workunit.client.0.smithi123.stdout:clone2 1 MiB rbd2/clone@s1 2 2023-12-06T15:29:03.613 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd -p rbd2 ls 2023-12-06T15:29:03.613 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -v clone2 2023-12-06T15:29:03.640 INFO:tasks.workunit.client.0.smithi123.stdout:clone 2023-12-06T15:29:03.640 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm clone2 2023-12-06T15:29:03.738 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:29:03.738+0000 7f14012b2700 0 -- 172.21.15.123:0/959993188 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7f13e4036c70 msgr2=0x7f13e40390c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:29:03.742 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:29:03.745 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap unprotect rbd2/clone@s1 2023-12-06T15:29:03.784 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap rm rbd2/clone@s1 2023-12-06T15:29:04.417 INFO:tasks.workunit.client.0.smithi123.stderr: Removing snap: 100% complete...done. 2023-12-06T15:29:04.426 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm rbd2/clone 2023-12-06T15:29:04.499 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:29:04.499+0000 7f596a3d6700 0 -- 172.21.15.123:0/2721689732 >> [v2:172.21.15.123:6808/114440,v1:172.21.15.123:6809/114440] conn(0x561edca021a0 msgr2=0x561edca045f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:29:04.505 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:29:04.507 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap unprotect test1@s1 2023-12-06T15:29:04.548 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap rm test1@s1 2023-12-06T15:29:05.428 INFO:tasks.workunit.client.0.smithi123.stderr: Removing snap: 100% complete...done. 2023-12-06T15:29:05.438 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test1 2023-12-06T15:29:05.532 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:29:05.532+0000 7f0bffd99700 0 -- 172.21.15.123:0/1963524500 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7f0be4036ec0 msgr2=0x7f0be4039310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:29:05.537 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:29:05.539 INFO:tasks.workunit.client.0.smithi123.stderr:+ ceph osd pool rm rbd2 rbd2 --yes-i-really-really-mean-it 2023-12-06T15:29:06.530 INFO:tasks.workunit.client.0.smithi123.stderr:pool 'rbd2' does not exist 2023-12-06T15:29:06.539 INFO:tasks.workunit.client.0.smithi123.stderr:+ test_trash 2023-12-06T15:29:06.539 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 'testing trash...' 2023-12-06T15:29:06.540 INFO:tasks.workunit.client.0.smithi123.stdout:testing trash... 2023-12-06T15:29:06.540 INFO:tasks.workunit.client.0.smithi123.stderr:+ remove_images 2023-12-06T15:29:06.540 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:06.620 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:06.695 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:06.769 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:06.844 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:06.921 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:06.995 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:07.070 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:07.145 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:07.220 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:07.295 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:07.370 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:07.447 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:07.523 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:07.598 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:07.673 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:07.748 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:07.823 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:07.898 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 -s 1 test1 2023-12-06T15:29:07.939 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 -s 1 test2 2023-12-06T15:29:07.984 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:29:07.984 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep test1 2023-12-06T15:29:08.009 INFO:tasks.workunit.client.0.smithi123.stdout:test1 2023-12-06T15:29:08.010 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:29:08.010 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep test2 2023-12-06T15:29:08.035 INFO:tasks.workunit.client.0.smithi123.stdout:test2 2023-12-06T15:29:08.036 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:29:08.036 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:08.036 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 2 2023-12-06T15:29:08.061 INFO:tasks.workunit.client.0.smithi123.stdout:2 2023-12-06T15:29:08.062 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls -l 2023-12-06T15:29:08.062 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'test1.*2.*' 2023-12-06T15:29:08.101 INFO:tasks.workunit.client.0.smithi123.stdout:test1 1 MiB 2 2023-12-06T15:29:08.101 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls -l 2023-12-06T15:29:08.102 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'test2.*2.*' 2023-12-06T15:29:08.136 INFO:tasks.workunit.client.0.smithi123.stdout:test2 1 MiB 2 2023-12-06T15:29:08.136 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv test1 2023-12-06T15:29:08.194 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:29:08.195 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep test2 2023-12-06T15:29:08.220 INFO:tasks.workunit.client.0.smithi123.stdout:test2 2023-12-06T15:29:08.221 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:29:08.221 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:08.221 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 1 2023-12-06T15:29:08.247 INFO:tasks.workunit.client.0.smithi123.stdout:1 2023-12-06T15:29:08.247 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls -l 2023-12-06T15:29:08.247 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'test2.*2.*' 2023-12-06T15:29:08.279 INFO:tasks.workunit.client.0.smithi123.stdout:test2 1 MiB 2 2023-12-06T15:29:08.279 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:08.280 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep test1 2023-12-06T15:29:08.305 INFO:tasks.workunit.client.0.smithi123.stdout:225c289c1b68 test1 2023-12-06T15:29:08.305 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:08.305 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:08.305 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 1 2023-12-06T15:29:08.331 INFO:tasks.workunit.client.0.smithi123.stdout:1 2023-12-06T15:29:08.331 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls -l 2023-12-06T15:29:08.331 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'test1.*USER.*' 2023-12-06T15:29:08.565 INFO:tasks.workunit.client.0.smithi123.stdout:225c289c1b68 test1 USER Wed Dec 6 15:29:08 2023 expired at Wed Dec 6 15:29:08 2023 2023-12-06T15:29:08.565 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls -l 2023-12-06T15:29:08.565 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -v 'protected until' 2023-12-06T15:29:08.597 INFO:tasks.workunit.client.0.smithi123.stdout:ID NAME SOURCE DELETED_AT STATUS PARENT 2023-12-06T15:29:08.598 INFO:tasks.workunit.client.0.smithi123.stdout:225c289c1b68 test1 USER Wed Dec 6 15:29:08 2023 expired at Wed Dec 6 15:29:08 2023 2023-12-06T15:29:08.598 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd trash ls 2023-12-06T15:29:08.598 INFO:tasks.workunit.client.0.smithi123.stderr:++ cut -d ' ' -f 1 2023-12-06T15:29:08.624 INFO:tasks.workunit.client.0.smithi123.stderr:+ ID=225c289c1b68 2023-12-06T15:29:08.624 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash rm 225c289c1b68 2023-12-06T15:29:08.679 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:29:08.682 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv test2 2023-12-06T15:29:08.737 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd trash ls 2023-12-06T15:29:08.737 INFO:tasks.workunit.client.0.smithi123.stderr:++ cut -d ' ' -f 1 2023-12-06T15:29:08.763 INFO:tasks.workunit.client.0.smithi123.stderr:+ ID=225f39e30485 2023-12-06T15:29:08.763 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info --image-id 225f39e30485 2023-12-06T15:29:08.763 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'rbd image '\''test2'\''' 2023-12-06T15:29:08.797 INFO:tasks.workunit.client.0.smithi123.stdout:rbd image 'test2': 2023-12-06T15:29:08.797 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash restore 225f39e30485 2023-12-06T15:29:08.833 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:29:08.834 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep test2 2023-12-06T15:29:08.859 INFO:tasks.workunit.client.0.smithi123.stdout:test2 2023-12-06T15:29:08.859 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:29:08.860 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:08.860 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 1 2023-12-06T15:29:08.885 INFO:tasks.workunit.client.0.smithi123.stdout:1 2023-12-06T15:29:08.885 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls -l 2023-12-06T15:29:08.885 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'test2.*2.*' 2023-12-06T15:29:08.917 INFO:tasks.workunit.client.0.smithi123.stdout:test2 1 MiB 2 2023-12-06T15:29:08.917 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv test2 --expires-at '3600 sec' 2023-12-06T15:29:08.973 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:08.973 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep test2 2023-12-06T15:29:08.999 INFO:tasks.workunit.client.0.smithi123.stdout:225f39e30485 test2 2023-12-06T15:29:08.999 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:09.000 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:09.000 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 1 2023-12-06T15:29:09.025 INFO:tasks.workunit.client.0.smithi123.stdout:1 2023-12-06T15:29:09.025 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls -l 2023-12-06T15:29:09.025 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'test2.*USER.*protected until' 2023-12-06T15:29:09.058 INFO:tasks.workunit.client.0.smithi123.stdout:225f39e30485 test2 USER Wed Dec 6 15:29:08 2023 protected until Wed Dec 6 16:29:08 2023 2023-12-06T15:29:09.058 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash rm 225f39e30485 2023-12-06T15:29:09.059 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'Deferment time has not expired' 2023-12-06T15:29:09.085 INFO:tasks.workunit.client.0.smithi123.stdout:Deferment time has not expired, please use --force if you really want to remove the image 2023-12-06T15:29:09.085 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash rm --image-id 225f39e30485 --force 2023-12-06T15:29:09.143 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:29:09.145 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 -s 1 test1 2023-12-06T15:29:09.186 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create test1@snap1 2023-12-06T15:29:10.247 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:29:10.259 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap protect test1@snap1 2023-12-06T15:29:10.303 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv test1 2023-12-06T15:29:10.361 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:10.361 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep test1 2023-12-06T15:29:10.386 INFO:tasks.workunit.client.0.smithi123.stdout:22b6d4c017ee test1 2023-12-06T15:29:10.387 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:10.387 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:10.387 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 1 2023-12-06T15:29:10.412 INFO:tasks.workunit.client.0.smithi123.stdout:1 2023-12-06T15:29:10.413 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls -l 2023-12-06T15:29:10.413 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'test1.*USER.*' 2023-12-06T15:29:10.446 INFO:tasks.workunit.client.0.smithi123.stdout:22b6d4c017ee test1 USER Wed Dec 6 15:29:10 2023 expired at Wed Dec 6 15:29:10 2023 2023-12-06T15:29:10.446 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls -l 2023-12-06T15:29:10.446 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -v 'protected until' 2023-12-06T15:29:10.479 INFO:tasks.workunit.client.0.smithi123.stdout:ID NAME SOURCE DELETED_AT STATUS PARENT 2023-12-06T15:29:10.479 INFO:tasks.workunit.client.0.smithi123.stdout:22b6d4c017ee test1 USER Wed Dec 6 15:29:10 2023 expired at Wed Dec 6 15:29:10 2023 2023-12-06T15:29:10.479 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd trash ls 2023-12-06T15:29:10.479 INFO:tasks.workunit.client.0.smithi123.stderr:++ cut -d ' ' -f 1 2023-12-06T15:29:10.506 INFO:tasks.workunit.client.0.smithi123.stderr:+ ID=22b6d4c017ee 2023-12-06T15:29:10.506 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap ls --image-id 22b6d4c017ee 2023-12-06T15:29:10.506 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -v SNAPID 2023-12-06T15:29:10.506 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:10.506 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 1 2023-12-06T15:29:10.540 INFO:tasks.workunit.client.0.smithi123.stdout:1 2023-12-06T15:29:10.540 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap ls --image-id 22b6d4c017ee 2023-12-06T15:29:10.540 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '.*snap1.*' 2023-12-06T15:29:10.574 INFO:tasks.workunit.client.0.smithi123.stdout: 34 snap1 1 MiB yes Wed Dec 6 15:29:10 2023 2023-12-06T15:29:10.575 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap unprotect --image-id 22b6d4c017ee --snap snap1 2023-12-06T15:29:10.619 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap rm --image-id 22b6d4c017ee --snap snap1 2023-12-06T15:29:11.245 INFO:tasks.workunit.client.0.smithi123.stderr: Removing snap: 100% complete...done. 2023-12-06T15:29:11.257 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap ls --image-id 22b6d4c017ee 2023-12-06T15:29:11.257 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -v SNAPID 2023-12-06T15:29:11.257 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:11.257 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 0 2023-12-06T15:29:11.291 INFO:tasks.workunit.client.0.smithi123.stdout:0 2023-12-06T15:29:11.292 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash restore 22b6d4c017ee 2023-12-06T15:29:11.328 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create test1@snap1 2023-12-06T15:29:12.249 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:29:12.258 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create test1@snap2 2023-12-06T15:29:13.241 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:29:13.251 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap ls --image-id 22b6d4c017ee 2023-12-06T15:29:13.252 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -v SNAPID 2023-12-06T15:29:13.252 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:13.252 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 2 2023-12-06T15:29:13.288 INFO:tasks.workunit.client.0.smithi123.stdout:2 2023-12-06T15:29:13.288 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap purge --image-id 22b6d4c017ee 2023-12-06T15:29:15.266 INFO:tasks.workunit.client.0.smithi123.stderr: Removing all snapshots: 50% complete... Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-12-06T15:29:15.278 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap ls --image-id 22b6d4c017ee 2023-12-06T15:29:15.278 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -v SNAPID 2023-12-06T15:29:15.278 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:15.278 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 0 2023-12-06T15:29:15.314 INFO:tasks.workunit.client.0.smithi123.stdout:0 2023-12-06T15:29:15.314 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm --rbd_move_to_trash_on_remove=true --rbd_move_to_trash_on_remove_expire_seconds=3600 test1 2023-12-06T15:29:15.370 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:29:15.373 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:15.373 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep test1 2023-12-06T15:29:15.399 INFO:tasks.workunit.client.0.smithi123.stdout:22b6d4c017ee test1 2023-12-06T15:29:15.400 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:15.400 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:15.400 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 1 2023-12-06T15:29:15.425 INFO:tasks.workunit.client.0.smithi123.stdout:1 2023-12-06T15:29:15.426 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls -l 2023-12-06T15:29:15.426 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'test1.*USER.*protected until' 2023-12-06T15:29:15.459 INFO:tasks.workunit.client.0.smithi123.stdout:22b6d4c017ee test1 USER Wed Dec 6 15:29:15 2023 protected until Wed Dec 6 16:29:15 2023 2023-12-06T15:29:15.460 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash rm 22b6d4c017ee 2023-12-06T15:29:15.460 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'Deferment time has not expired' 2023-12-06T15:29:15.486 INFO:tasks.workunit.client.0.smithi123.stdout:Deferment time has not expired, please use --force if you 2023-12-06T15:29:15.484+0000 7ff77a4a6380 -1 librbd::api::Trash: remove: error: deferment time has not expired. 2023-12-06T15:29:15.486 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash rm --image-id 22b6d4c017ee --force 2023-12-06T15:29:15.545 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:29:15.547 INFO:tasks.workunit.client.0.smithi123.stderr:+ remove_images 2023-12-06T15:29:15.547 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:15.623 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:15.699 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:15.774 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:15.851 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:15.927 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:16.003 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:16.079 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:16.156 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:16.232 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:16.309 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:16.385 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:16.461 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:16.538 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:16.613 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:16.687 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:16.763 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:16.839 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:16.914 INFO:tasks.workunit.client.0.smithi123.stderr:+ test_purge 2023-12-06T15:29:16.914 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 'testing trash purge...' 2023-12-06T15:29:16.915 INFO:tasks.workunit.client.0.smithi123.stdout:testing trash purge... 2023-12-06T15:29:16.915 INFO:tasks.workunit.client.0.smithi123.stderr:+ remove_images 2023-12-06T15:29:16.915 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:16.990 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:17.065 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:17.139 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:17.214 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:17.290 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:17.365 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:17.440 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:17.516 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:17.591 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:17.668 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:17.943 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:18.018 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:18.092 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:18.168 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:18.248 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:18.324 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:18.399 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:18.475 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:18.475 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:18.475 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 0 2023-12-06T15:29:18.500 INFO:tasks.workunit.client.0.smithi123.stdout:0 2023-12-06T15:29:18.500 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash purge 2023-12-06T15:29:18.523 INFO:tasks.workunit.client.0.smithi123.stderr: Removing images: 100% complete...done. 2023-12-06T15:29:18.525 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-12-06T15:29:18.573 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 --size 256 testimg2 2023-12-06T15:29:18.615 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv testimg1 2023-12-06T15:29:18.673 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv testimg2 2023-12-06T15:29:18.728 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:18.728 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:18.728 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 2 2023-12-06T15:29:18.753 INFO:tasks.workunit.client.0.smithi123.stdout:2 2023-12-06T15:29:18.753 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash purge 2023-12-06T15:29:18.837 INFO:tasks.workunit.client.0.smithi123.stderr: Removing images: 50% complete... Removing images: 100% complete... Removing images: 100% complete...done. 2023-12-06T15:29:18.839 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:18.840 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:18.840 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 0 2023-12-06T15:29:18.865 INFO:tasks.workunit.client.0.smithi123.stdout:0 2023-12-06T15:29:18.865 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-12-06T15:29:18.908 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 --size 256 testimg2 2023-12-06T15:29:18.951 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv testimg1 --expires-at '1 hour' 2023-12-06T15:29:19.014 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv testimg2 --expires-at '3 hours' 2023-12-06T15:29:19.074 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:19.074 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:19.075 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 2 2023-12-06T15:29:19.099 INFO:tasks.workunit.client.0.smithi123.stdout:2 2023-12-06T15:29:19.100 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash purge 2023-12-06T15:29:19.123 INFO:tasks.workunit.client.0.smithi123.stderr: Removing images: 100% complete...done. 2023-12-06T15:29:19.126 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:19.126 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:19.126 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 2 2023-12-06T15:29:19.152 INFO:tasks.workunit.client.0.smithi123.stdout:2 2023-12-06T15:29:19.152 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash purge --expired-before 'now + 2 hours' 2023-12-06T15:29:19.210 INFO:tasks.workunit.client.0.smithi123.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-12-06T15:29:19.213 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:19.213 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:19.213 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 1 2023-12-06T15:29:19.238 INFO:tasks.workunit.client.0.smithi123.stdout:1 2023-12-06T15:29:19.238 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:19.239 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep testimg2 2023-12-06T15:29:19.264 INFO:tasks.workunit.client.0.smithi123.stdout:23f9cd4cd9c testimg2 2023-12-06T15:29:19.264 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash purge --expired-before 'now + 4 hours' 2023-12-06T15:29:19.325 INFO:tasks.workunit.client.0.smithi123.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-12-06T15:29:19.328 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:19.328 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:19.328 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 0 2023-12-06T15:29:19.353 INFO:tasks.workunit.client.0.smithi123.stdout:0 2023-12-06T15:29:19.353 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-12-06T15:29:19.396 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create testimg1@snap 2023-12-06T15:29:20.270 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:29:20.279 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 --size 256 testimg2 2023-12-06T15:29:20.326 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-12-06T15:29:20.369 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv testimg1 2023-12-06T15:29:20.422 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv testimg2 2023-12-06T15:29:20.484 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv testimg3 2023-12-06T15:29:20.543 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:20.543 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:20.543 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 3 2023-12-06T15:29:20.568 INFO:tasks.workunit.client.0.smithi123.stdout:3 2023-12-06T15:29:20.569 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash purge 2023-12-06T15:29:20.569 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'some expired images could not be removed' 2023-12-06T15:29:20.700 INFO:tasks.workunit.client.0.smithi123.stdout:rbd: some expired images could not be removed 2023-12-06T15:29:20.700 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:20.700 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:20.700 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 1 2023-12-06T15:29:20.726 INFO:tasks.workunit.client.0.smithi123.stdout:1 2023-12-06T15:29:20.726 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:20.726 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep testimg1 2023-12-06T15:29:20.752 INFO:tasks.workunit.client.0.smithi123.stdout:241a2be73921 testimg1 2023-12-06T15:29:20.752 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd trash ls 2023-12-06T15:29:20.752 INFO:tasks.workunit.client.0.smithi123.stderr:++ awk '{ print $1 }' 2023-12-06T15:29:20.778 INFO:tasks.workunit.client.0.smithi123.stderr:+ ID=241a2be73921 2023-12-06T15:29:20.778 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap purge --image-id 241a2be73921 2023-12-06T15:29:21.269 INFO:tasks.workunit.client.0.smithi123.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-12-06T15:29:21.279 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash purge 2023-12-06T15:29:21.336 INFO:tasks.workunit.client.0.smithi123.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-12-06T15:29:21.338 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:21.339 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:21.339 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 0 2023-12-06T15:29:21.364 INFO:tasks.workunit.client.0.smithi123.stdout:0 2023-12-06T15:29:21.364 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-12-06T15:29:21.406 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 --size 256 testimg2 2023-12-06T15:29:21.448 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create testimg2@snap 2023-12-06T15:29:22.278 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:29:22.287 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-12-06T15:29:22.332 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv testimg1 2023-12-06T15:29:22.389 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv testimg2 2023-12-06T15:29:22.445 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv testimg3 2023-12-06T15:29:22.501 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:22.501 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:22.501 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 3 2023-12-06T15:29:22.526 INFO:tasks.workunit.client.0.smithi123.stdout:3 2023-12-06T15:29:22.527 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash purge 2023-12-06T15:29:22.527 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'some expired images could not be removed' 2023-12-06T15:29:22.662 INFO:tasks.workunit.client.0.smithi123.stdout:rbd: some expired images could not be removed 2023-12-06T15:29:22.662 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:22.663 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:22.663 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 1 2023-12-06T15:29:22.687 INFO:tasks.workunit.client.0.smithi123.stdout:1 2023-12-06T15:29:22.689 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:22.689 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep testimg2 2023-12-06T15:29:22.713 INFO:tasks.workunit.client.0.smithi123.stdout:244a920acaa6 testimg2 2023-12-06T15:29:22.713 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd trash ls 2023-12-06T15:29:22.714 INFO:tasks.workunit.client.0.smithi123.stderr:++ awk '{ print $1 }' 2023-12-06T15:29:22.739 INFO:tasks.workunit.client.0.smithi123.stderr:+ ID=244a920acaa6 2023-12-06T15:29:22.740 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap purge --image-id 244a920acaa6 2023-12-06T15:29:23.278 INFO:tasks.workunit.client.0.smithi123.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-12-06T15:29:23.291 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash purge 2023-12-06T15:29:23.354 INFO:tasks.workunit.client.0.smithi123.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-12-06T15:29:23.357 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:23.357 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:23.357 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 0 2023-12-06T15:29:23.382 INFO:tasks.workunit.client.0.smithi123.stdout:0 2023-12-06T15:29:23.383 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-12-06T15:29:23.426 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 --size 256 testimg2 2023-12-06T15:29:23.469 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-12-06T15:29:23.515 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create testimg3@snap 2023-12-06T15:29:24.290 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:29:24.300 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv testimg1 2023-12-06T15:29:24.359 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv testimg2 2023-12-06T15:29:24.415 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv testimg3 2023-12-06T15:29:24.470 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:24.470 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:24.470 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 3 2023-12-06T15:29:24.495 INFO:tasks.workunit.client.0.smithi123.stdout:3 2023-12-06T15:29:24.496 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash purge 2023-12-06T15:29:24.496 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'some expired images could not be removed' 2023-12-06T15:29:24.626 INFO:tasks.workunit.client.0.smithi123.stdout:rbd: some expired images could not be removed 2023-12-06T15:29:24.627 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:24.627 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:24.627 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 1 2023-12-06T15:29:24.652 INFO:tasks.workunit.client.0.smithi123.stdout:1 2023-12-06T15:29:24.653 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:24.653 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep testimg3 2023-12-06T15:29:24.678 INFO:tasks.workunit.client.0.smithi123.stdout:247ac252fc6b testimg3 2023-12-06T15:29:24.678 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd trash ls 2023-12-06T15:29:24.678 INFO:tasks.workunit.client.0.smithi123.stderr:++ awk '{ print $1 }' 2023-12-06T15:29:24.705 INFO:tasks.workunit.client.0.smithi123.stderr:+ ID=247ac252fc6b 2023-12-06T15:29:24.705 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap purge --image-id 247ac252fc6b 2023-12-06T15:29:25.280 INFO:tasks.workunit.client.0.smithi123.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-12-06T15:29:25.293 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash purge 2023-12-06T15:29:25.351 INFO:tasks.workunit.client.0.smithi123.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-12-06T15:29:25.353 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:25.353 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:25.353 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 0 2023-12-06T15:29:25.379 INFO:tasks.workunit.client.0.smithi123.stdout:0 2023-12-06T15:29:25.379 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-12-06T15:29:25.421 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create testimg1@snap 2023-12-06T15:29:26.289 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:29:26.298 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2023-12-06T15:29:26.368 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap rm testimg1@snap 2023-12-06T15:29:26.408 INFO:tasks.workunit.client.0.smithi123.stderr: Removing snap: 100% complete...done. 2023-12-06T15:29:26.415 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-12-06T15:29:26.460 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create testimg2@snap 2023-12-06T15:29:27.301 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:29:27.312 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2023-12-06T15:29:27.395 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2023-12-06T15:29:27.466 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap rm testimg2@snap 2023-12-06T15:29:27.512 INFO:tasks.workunit.client.0.smithi123.stderr: Removing snap: 100% complete...done. 2023-12-06T15:29:27.520 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create testimg4@snap 2023-12-06T15:29:28.246 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:29:28.257 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2023-12-06T15:29:28.344 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap rm testimg4@snap 2023-12-06T15:29:28.397 INFO:tasks.workunit.client.0.smithi123.stderr: Removing snap: 100% complete...done. 2023-12-06T15:29:28.406 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv testimg1 2023-12-06T15:29:28.460 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv testimg2 2023-12-06T15:29:28.515 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv testimg3 2023-12-06T15:29:28.576 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv testimg4 2023-12-06T15:29:28.632 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:28.633 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:28.633 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 4 2023-12-06T15:29:28.657 INFO:tasks.workunit.client.0.smithi123.stdout:4 2023-12-06T15:29:28.658 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash purge 2023-12-06T15:29:28.658 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'some expired images could not be removed' 2023-12-06T15:29:28.853 INFO:tasks.workunit.client.0.smithi123.stdout:rbd: some expired images could not be removed 2023-12-06T15:29:28.853 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:28.853 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:28.853 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 3 2023-12-06T15:29:28.878 INFO:tasks.workunit.client.0.smithi123.stdout:3 2023-12-06T15:29:28.879 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:28.879 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep testimg1 2023-12-06T15:29:28.904 INFO:tasks.workunit.client.0.smithi123.stdout:24a11a72f4fb testimg1 2023-12-06T15:29:28.904 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:28.904 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep testimg2 2023-12-06T15:29:28.929 INFO:tasks.workunit.client.0.smithi123.stdout:24a76cb1b811 testimg2 2023-12-06T15:29:28.930 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:28.930 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep testimg4 2023-12-06T15:29:28.955 INFO:tasks.workunit.client.0.smithi123.stdout:24b317bc5531 testimg4 2023-12-06T15:29:28.955 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv testimg6 2023-12-06T15:29:29.012 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:29.012 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:29.013 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 4 2023-12-06T15:29:29.038 INFO:tasks.workunit.client.0.smithi123.stdout:4 2023-12-06T15:29:29.038 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash purge 2023-12-06T15:29:29.039 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'some expired images could not be removed' 2023-12-06T15:29:29.451 INFO:tasks.workunit.client.0.smithi123.stdout:rbd: some expired images could not be removed 2023-12-06T15:29:29.452 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:29.452 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:29.452 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 2 2023-12-06T15:29:29.477 INFO:tasks.workunit.client.0.smithi123.stdout:2 2023-12-06T15:29:29.478 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:29.478 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep testimg1 2023-12-06T15:29:29.503 INFO:tasks.workunit.client.0.smithi123.stdout:24a11a72f4fb testimg1 2023-12-06T15:29:29.503 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:29.503 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep testimg2 2023-12-06T15:29:29.529 INFO:tasks.workunit.client.0.smithi123.stdout:24a76cb1b811 testimg2 2023-12-06T15:29:29.529 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv testimg5 2023-12-06T15:29:29.585 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:29.585 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:29.585 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 3 2023-12-06T15:29:29.610 INFO:tasks.workunit.client.0.smithi123.stdout:3 2023-12-06T15:29:29.610 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash purge 2023-12-06T15:29:29.697 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:29:29.697+0000 7f5083ac7700 0 -- 172.21.15.123:0/1359196900 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7f505c04f950 msgr2=0x7f505c051d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:29:29.711 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:29:29.711+0000 7f5083ac7700 0 -- 172.21.15.123:0/1359196900 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7f50640367f0 msgr2=0x7f5064038c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:29:31.369 INFO:tasks.workunit.client.0.smithi123.stderr: Removing images: 33% complete... Removing images: 66% complete... Removing images: 100% complete... Removing images: 100% complete...done. 2023-12-06T15:29:31.372 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:31.372 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:31.372 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 0 2023-12-06T15:29:31.400 INFO:tasks.workunit.client.0.smithi123.stdout:0 2023-12-06T15:29:31.400 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-12-06T15:29:31.443 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create testimg1@snap 2023-12-06T15:29:32.307 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:29:32.316 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2023-12-06T15:29:32.389 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap rm testimg1@snap 2023-12-06T15:29:32.430 INFO:tasks.workunit.client.0.smithi123.stderr: Removing snap: 100% complete...done. 2023-12-06T15:29:32.438 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-12-06T15:29:32.480 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create testimg3@snap 2023-12-06T15:29:33.314 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:29:33.323 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create testimg2@snap 2023-12-06T15:29:34.323 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:29:34.334 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2023-12-06T15:29:34.414 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2023-12-06T15:29:34.487 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap rm testimg2@snap 2023-12-06T15:29:34.535 INFO:tasks.workunit.client.0.smithi123.stderr: Removing snap: 100% complete...done. 2023-12-06T15:29:34.543 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create testimg4@snap 2023-12-06T15:29:35.322 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:29:35.332 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2023-12-06T15:29:35.414 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap rm testimg4@snap 2023-12-06T15:29:35.468 INFO:tasks.workunit.client.0.smithi123.stderr: Removing snap: 100% complete...done. 2023-12-06T15:29:35.477 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv testimg1 2023-12-06T15:29:35.532 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv testimg2 2023-12-06T15:29:35.591 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv testimg3 2023-12-06T15:29:35.645 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv testimg4 2023-12-06T15:29:35.701 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:35.702 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:35.702 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 4 2023-12-06T15:29:35.727 INFO:tasks.workunit.client.0.smithi123.stdout:4 2023-12-06T15:29:35.728 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash purge 2023-12-06T15:29:35.728 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'some expired images could not be removed' 2023-12-06T15:29:35.849 INFO:tasks.workunit.client.0.smithi123.stdout:rbd: some expired images could not be removed 2023-12-06T15:29:35.849 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:35.849 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:35.849 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 4 2023-12-06T15:29:35.874 INFO:tasks.workunit.client.0.smithi123.stdout:4 2023-12-06T15:29:35.875 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv testimg6 2023-12-06T15:29:35.932 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:35.932 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:35.932 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 5 2023-12-06T15:29:35.957 INFO:tasks.workunit.client.0.smithi123.stdout:5 2023-12-06T15:29:35.958 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash purge 2023-12-06T15:29:35.958 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'some expired images could not be removed' 2023-12-06T15:29:36.518 INFO:tasks.workunit.client.0.smithi123.stdout:rbd: some expired images could not be removed 2023-12-06T15:29:36.519 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:36.519 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:36.519 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 3 2023-12-06T15:29:36.544 INFO:tasks.workunit.client.0.smithi123.stdout:3 2023-12-06T15:29:36.544 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:36.544 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep testimg1 2023-12-06T15:29:36.569 INFO:tasks.workunit.client.0.smithi123.stdout:2501d499907d testimg1 2023-12-06T15:29:36.570 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:36.570 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep testimg2 2023-12-06T15:29:36.595 INFO:tasks.workunit.client.0.smithi123.stdout:2507f99bdcf testimg2 2023-12-06T15:29:36.596 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:36.596 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep testimg3 2023-12-06T15:29:36.621 INFO:tasks.workunit.client.0.smithi123.stdout:250d460e431c testimg3 2023-12-06T15:29:36.621 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv testimg5 2023-12-06T15:29:36.680 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:36.680 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:36.680 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 4 2023-12-06T15:29:36.705 INFO:tasks.workunit.client.0.smithi123.stdout:4 2023-12-06T15:29:36.705 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash purge 2023-12-06T15:29:36.705 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'some expired images could not be removed' 2023-12-06T15:29:38.372 INFO:tasks.workunit.client.0.smithi123.stdout:rbd: some expired images could not be removed 2023-12-06T15:29:38.373 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:38.373 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:38.373 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 1 2023-12-06T15:29:38.593 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:29:38.592+0000 7f10f17b3700 0 --2- 172.21.15.123:0/3879223821 >> v2:172.21.15.123:3300/0 conn(0x55c7e0563140 0x55c7e055fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-12-06T15:29:38.600 INFO:tasks.workunit.client.0.smithi123.stdout:1 2023-12-06T15:29:38.600 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:38.601 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep testimg3 2023-12-06T15:29:38.626 INFO:tasks.workunit.client.0.smithi123.stdout:250d460e431c testimg3 2023-12-06T15:29:38.627 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd trash ls 2023-12-06T15:29:38.627 INFO:tasks.workunit.client.0.smithi123.stderr:++ awk '{ print $1 }' 2023-12-06T15:29:38.653 INFO:tasks.workunit.client.0.smithi123.stderr:+ ID=250d460e431c 2023-12-06T15:29:38.653 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap purge --image-id 250d460e431c 2023-12-06T15:29:39.332 INFO:tasks.workunit.client.0.smithi123.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-12-06T15:29:39.343 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash purge 2023-12-06T15:29:39.400 INFO:tasks.workunit.client.0.smithi123.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-12-06T15:29:39.403 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:39.403 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:39.403 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 0 2023-12-06T15:29:39.429 INFO:tasks.workunit.client.0.smithi123.stdout:0 2023-12-06T15:29:39.429 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-12-06T15:29:39.472 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create testimg1@snap 2023-12-06T15:29:40.340 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:29:40.350 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2023-12-06T15:29:40.420 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap rm testimg1@snap 2023-12-06T15:29:40.462 INFO:tasks.workunit.client.0.smithi123.stderr: Removing snap: 100% complete...done. 2023-12-06T15:29:40.470 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-12-06T15:29:40.512 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create testimg2@snap 2023-12-06T15:29:41.346 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:29:41.357 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2023-12-06T15:29:41.437 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2023-12-06T15:29:41.509 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap rm testimg2@snap 2023-12-06T15:29:41.555 INFO:tasks.workunit.client.0.smithi123.stderr: Removing snap: 100% complete...done. 2023-12-06T15:29:41.565 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create testimg4@snap 2023-12-06T15:29:42.349 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:29:42.361 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2023-12-06T15:29:42.441 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap rm testimg4@snap 2023-12-06T15:29:42.492 INFO:tasks.workunit.client.0.smithi123.stderr: Removing snap: 100% complete...done. 2023-12-06T15:29:42.500 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg1 2023-12-06T15:29:42.574 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:29:42.576 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg2 2023-12-06T15:29:42.651 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:29:42.653 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv testimg3 2023-12-06T15:29:42.710 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg4 2023-12-06T15:29:42.781 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:29:42.784 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:42.784 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:42.784 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 4 2023-12-06T15:29:42.809 INFO:tasks.workunit.client.0.smithi123.stdout:4 2023-12-06T15:29:42.810 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash purge 2023-12-06T15:29:42.810 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'some expired images could not be removed' 2023-12-06T15:29:43.007 INFO:tasks.workunit.client.0.smithi123.stdout:rbd: some expired images could not be removed 2023-12-06T15:29:43.007 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:43.007 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:43.007 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 3 2023-12-06T15:29:43.032 INFO:tasks.workunit.client.0.smithi123.stdout:3 2023-12-06T15:29:43.033 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:43.033 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep testimg1 2023-12-06T15:29:43.058 INFO:tasks.workunit.client.0.smithi123.stdout:256dc574dd55 testimg1 2023-12-06T15:29:43.059 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:43.059 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep testimg2 2023-12-06T15:29:43.084 INFO:tasks.workunit.client.0.smithi123.stdout:257342835427 testimg2 2023-12-06T15:29:43.085 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:43.085 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep testimg4 2023-12-06T15:29:43.111 INFO:tasks.workunit.client.0.smithi123.stdout:257fff33e577 testimg4 2023-12-06T15:29:43.111 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv testimg6 2023-12-06T15:29:43.169 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:43.169 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:43.169 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 4 2023-12-06T15:29:43.194 INFO:tasks.workunit.client.0.smithi123.stdout:4 2023-12-06T15:29:43.195 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash purge 2023-12-06T15:29:43.195 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'some expired images could not be removed' 2023-12-06T15:29:44.344 INFO:tasks.workunit.client.0.smithi123.stdout:rbd: some expired images could not be removed 2023-12-06T15:29:44.345 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:44.345 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:44.345 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 2 2023-12-06T15:29:44.371 INFO:tasks.workunit.client.0.smithi123.stdout:2 2023-12-06T15:29:44.371 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:44.371 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep testimg1 2023-12-06T15:29:44.397 INFO:tasks.workunit.client.0.smithi123.stdout:256dc574dd55 testimg1 2023-12-06T15:29:44.397 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:44.397 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep testimg2 2023-12-06T15:29:44.422 INFO:tasks.workunit.client.0.smithi123.stdout:257342835427 testimg2 2023-12-06T15:29:44.423 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv testimg5 2023-12-06T15:29:44.479 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:44.479 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:44.480 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 3 2023-12-06T15:29:44.505 INFO:tasks.workunit.client.0.smithi123.stdout:3 2023-12-06T15:29:44.506 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash purge 2023-12-06T15:29:44.592 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:29:44.591+0000 7f9efad0e700 0 -- 172.21.15.123:0/2464607331 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7f9edc051b60 msgr2=0x7f9edc053f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:29:44.605 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:29:44.603+0000 7f9efb50f700 0 -- 172.21.15.123:0/2464607331 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x561677e545c0 msgr2=0x561677e66180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:29:46.427 INFO:tasks.workunit.client.0.smithi123.stderr: Removing images: 33% complete... Removing images: 66% complete... Removing images: 100% complete... Removing images: 100% complete...done. 2023-12-06T15:29:46.431 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:46.431 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:46.431 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 0 2023-12-06T15:29:46.457 INFO:tasks.workunit.client.0.smithi123.stdout:0 2023-12-06T15:29:46.457 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-12-06T15:29:46.502 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create testimg1@snap 2023-12-06T15:29:47.362 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:29:47.372 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2023-12-06T15:29:47.444 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap rm testimg1@snap 2023-12-06T15:29:47.485 INFO:tasks.workunit.client.0.smithi123.stderr: Removing snap: 100% complete...done. 2023-12-06T15:29:47.494 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-12-06T15:29:47.540 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create testimg3@snap 2023-12-06T15:29:48.250 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:29:48.260 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create testimg2@snap 2023-12-06T15:29:49.249 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:29:49.261 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2023-12-06T15:29:49.339 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2023-12-06T15:29:49.407 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap rm testimg2@snap 2023-12-06T15:29:49.456 INFO:tasks.workunit.client.0.smithi123.stderr: Removing snap: 100% complete...done. 2023-12-06T15:29:49.465 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create testimg4@snap 2023-12-06T15:29:50.369 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:29:50.380 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2023-12-06T15:29:50.459 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap rm testimg4@snap 2023-12-06T15:29:50.513 INFO:tasks.workunit.client.0.smithi123.stderr: Removing snap: 100% complete...done. 2023-12-06T15:29:50.523 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg1 2023-12-06T15:29:50.598 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:29:50.600 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg2 2023-12-06T15:29:50.676 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:29:50.679 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv testimg3 2023-12-06T15:29:50.738 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg4 2023-12-06T15:29:50.813 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:29:50.816 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:50.816 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:50.816 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 4 2023-12-06T15:29:50.842 INFO:tasks.workunit.client.0.smithi123.stdout:4 2023-12-06T15:29:50.842 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash purge 2023-12-06T15:29:50.842 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'some expired images could not be removed' 2023-12-06T15:29:50.973 INFO:tasks.workunit.client.0.smithi123.stdout:rbd: some expired images could not be removed 2023-12-06T15:29:50.973 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:50.973 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:50.973 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 4 2023-12-06T15:29:50.999 INFO:tasks.workunit.client.0.smithi123.stdout:4 2023-12-06T15:29:50.999 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv testimg6 2023-12-06T15:29:51.054 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:51.054 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:51.054 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 5 2023-12-06T15:29:51.079 INFO:tasks.workunit.client.0.smithi123.stdout:5 2023-12-06T15:29:51.079 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash purge 2023-12-06T15:29:51.079 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'some expired images could not be removed' 2023-12-06T15:29:51.482 INFO:tasks.workunit.client.0.smithi123.stdout:rbd: some expired images could not be removed 2023-12-06T15:29:51.483 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:51.483 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:51.483 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 3 2023-12-06T15:29:51.509 INFO:tasks.workunit.client.0.smithi123.stdout:3 2023-12-06T15:29:51.509 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:51.509 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep testimg1 2023-12-06T15:29:51.535 INFO:tasks.workunit.client.0.smithi123.stdout:25cd5b0a5be4 testimg1 2023-12-06T15:29:51.535 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:51.535 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep testimg2 2023-12-06T15:29:51.560 INFO:tasks.workunit.client.0.smithi123.stdout:25d3a3ca886c testimg2 2023-12-06T15:29:51.561 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:51.561 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep testimg3 2023-12-06T15:29:51.586 INFO:tasks.workunit.client.0.smithi123.stdout:25d937675250 testimg3 2023-12-06T15:29:51.586 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash mv testimg5 2023-12-06T15:29:51.647 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:51.647 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:51.647 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 4 2023-12-06T15:29:51.672 INFO:tasks.workunit.client.0.smithi123.stdout:4 2023-12-06T15:29:51.672 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash purge 2023-12-06T15:29:51.673 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'some expired images could not be removed' 2023-12-06T15:29:53.490 INFO:tasks.workunit.client.0.smithi123.stdout:rbd: some expired images could not be removed 2023-12-06T15:29:53.491 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:53.491 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:53.491 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 1 2023-12-06T15:29:53.517 INFO:tasks.workunit.client.0.smithi123.stdout:1 2023-12-06T15:29:53.517 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:53.517 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep testimg3 2023-12-06T15:29:53.543 INFO:tasks.workunit.client.0.smithi123.stdout:25d937675250 testimg3 2023-12-06T15:29:53.543 INFO:tasks.workunit.client.0.smithi123.stderr:++ rbd trash ls 2023-12-06T15:29:53.543 INFO:tasks.workunit.client.0.smithi123.stderr:++ awk '{ print $1 }' 2023-12-06T15:29:53.569 INFO:tasks.workunit.client.0.smithi123.stderr:+ ID=25d937675250 2023-12-06T15:29:53.569 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap purge --image-id 25d937675250 2023-12-06T15:29:54.377 INFO:tasks.workunit.client.0.smithi123.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-12-06T15:29:54.388 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash purge 2023-12-06T15:29:54.455 INFO:tasks.workunit.client.0.smithi123.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-12-06T15:29:54.458 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls 2023-12-06T15:29:54.458 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:54.458 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 0 2023-12-06T15:29:54.484 INFO:tasks.workunit.client.0.smithi123.stdout:0 2023-12-06T15:29:54.484 INFO:tasks.workunit.client.0.smithi123.stderr:+ test_deep_copy_clone 2023-12-06T15:29:54.484 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 'testing deep copy clone...' 2023-12-06T15:29:54.485 INFO:tasks.workunit.client.0.smithi123.stdout:testing deep copy clone... 2023-12-06T15:29:54.485 INFO:tasks.workunit.client.0.smithi123.stderr:+ remove_images 2023-12-06T15:29:54.485 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:54.567 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:54.645 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:54.724 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:54.803 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:54.881 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:54.958 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:55.038 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:55.319 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:55.401 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:55.479 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:55.560 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:55.641 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:55.720 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:55.800 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:55.878 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:56.160 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:56.241 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:29:56.322 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create testimg1 --image-format 2 --size 256 2023-12-06T15:29:56.364 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create testimg1 --snap=snap1 2023-12-06T15:29:57.400 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:29:57.412 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap protect testimg1@snap1 2023-12-06T15:29:57.457 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd clone testimg1@snap1 testimg2 2023-12-06T15:29:57.527 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create testimg2@snap2 2023-12-06T15:29:58.253 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:29:58.264 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd deep copy testimg2 testimg3 2023-12-06T15:29:59.240 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:29:59.240+0000 7f2c3d4cd700 0 -- 172.21.15.123:0/3737993608 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7f2c18008780 msgr2=0x7f2c1800abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T15:29:59.265 INFO:tasks.workunit.client.0.smithi123.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-12-06T15:29:59.269 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info testimg3 2023-12-06T15:29:59.269 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'size 256 MiB' 2023-12-06T15:29:59.312 INFO:tasks.workunit.client.0.smithi123.stdout: size 256 MiB in 64 objects 2023-12-06T15:29:59.312 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info testimg3 2023-12-06T15:29:59.312 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'parent: rbd/testimg1@snap1' 2023-12-06T15:29:59.352 INFO:tasks.workunit.client.0.smithi123.stdout: parent: rbd/testimg1@snap1 2023-12-06T15:29:59.353 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap ls testimg3 2023-12-06T15:29:59.353 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -v SNAPID 2023-12-06T15:29:59.353 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:29:59.353 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 1 2023-12-06T15:29:59.392 INFO:tasks.workunit.client.0.smithi123.stdout:1 2023-12-06T15:29:59.392 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap ls testimg3 2023-12-06T15:29:59.392 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '.*snap2.*' 2023-12-06T15:29:59.431 INFO:tasks.workunit.client.0.smithi123.stdout: 76 snap2 256 MiB Wed Dec 6 15:29:59 2023 2023-12-06T15:29:59.431 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info testimg2 2023-12-06T15:29:59.431 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'features:.*deep-flatten' 2023-12-06T15:29:59.469 INFO:tasks.workunit.client.0.smithi123.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 2023-12-06T15:29:59.470 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info testimg3 2023-12-06T15:29:59.470 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'features:.*deep-flatten' 2023-12-06T15:29:59.508 INFO:tasks.workunit.client.0.smithi123.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 2023-12-06T15:29:59.508 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd flatten testimg2 2023-12-06T15:29:59.556 INFO:tasks.workunit.client.0.smithi123.stderr: Image flatten: 1% complete... Image flatten: 3% complete... Image flatten: 4% complete... Image flatten: 6% complete... Image flatten: 7% complete... Image flatten: 9% complete... Image flatten: 10% complete... Image flatten: 12% complete... Image flatten: 14% complete... Image flatten: 15% complete... Image flatten: 17% complete... Image flatten: 18% complete... Image flatten: 20% complete... Image flatten: 21% complete... Image flatten: 23% complete... Image flatten: 25% complete... Image flatten: 26% complete... Image flatten: 28% complete... Image flatten: 29% complete... Image flatten: 31% complete... Image flatten: 32% complete... Image flatten: 34% complete... Image flatten: 35% complete... Image flatten: 37% complete... Image flatten: 39% complete... Image flatten: 40% complete... Image flatten: 42% complete... Image flatten: 43% complete... Image flatten: 45% complete... Image flatten: 46% complete... Image flatten: 48% complete... Image flatten: 50% complete... Image flatten: 51% complete... Image flatten: 53% complete... Image flatten: 54% complete... Image flatten: 56% complete... Image flatten: 57% complete... Image flatten: 59% complete... Image flatten: 60% complete... Image flatten: 62% complete... Image flatten: 64% complete... Image flatten: 65% complete... Image flatten: 67% complete... Image flatten: 68% complete... Image flatten: 70% complete... Image flatten: 71% complete... Image flatten: 73% complete... Image flatten: 75% complete... Image flatten: 76% complete... Image flatten: 78% complete... Image flatten: 79% complete... Image flatten: 81% complete... Image flatten: 82% complete... Image flatten: 84% complete... Image flatten: 85% complete... Image flatten: 87% complete... Image flatten: 89% complete... Image flatten: 90% complete... Image flatten: 92% complete... Image flatten: 93% complete... Image flatten: 95% complete... Image flatten: 96% complete... Image flatten: 98% complete... Image flatten: 100% complete...done. 2023-12-06T15:29:59.564 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd flatten testimg3 2023-12-06T15:29:59.611 INFO:tasks.workunit.client.0.smithi123.stderr: Image flatten: 1% complete... Image flatten: 3% complete... Image flatten: 4% complete... Image flatten: 6% complete... Image flatten: 7% complete... Image flatten: 9% complete... Image flatten: 10% complete... Image flatten: 12% complete... Image flatten: 14% complete... Image flatten: 15% complete... Image flatten: 17% complete... Image flatten: 18% complete... Image flatten: 20% complete... Image flatten: 21% complete... Image flatten: 23% complete... Image flatten: 25% complete... Image flatten: 26% complete... Image flatten: 28% complete... Image flatten: 29% complete... Image flatten: 31% complete... Image flatten: 32% complete... Image flatten: 34% complete... Image flatten: 35% complete... Image flatten: 37% complete... Image flatten: 39% complete... Image flatten: 40% complete... Image flatten: 42% complete... Image flatten: 43% complete... Image flatten: 45% complete... Image flatten: 46% complete... Image flatten: 48% complete... Image flatten: 50% complete... Image flatten: 51% complete... Image flatten: 53% complete... Image flatten: 54% complete... Image flatten: 56% complete... Image flatten: 57% complete... Image flatten: 59% complete... Image flatten: 60% complete... Image flatten: 62% complete... Image flatten: 64% complete... Image flatten: 65% complete... Image flatten: 67% complete... Image flatten: 68% complete... Image flatten: 70% complete... Image flatten: 71% complete... Image flatten: 73% complete... Image flatten: 75% complete... Image flatten: 76% complete... Image flatten: 78% complete... Image flatten: 79% complete... Image flatten: 81% complete... Image flatten: 82% complete... Image flatten: 84% complete... Image flatten: 85% complete... Image flatten: 87% complete... Image flatten: 89% complete... Image flatten: 90% complete... Image flatten: 92% complete... Image flatten: 93% complete... Image flatten: 95% complete... Image flatten: 96% complete... Image flatten: 98% complete... Image flatten: 100% complete...done. 2023-12-06T15:29:59.617 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap unprotect testimg1@snap1 2023-12-06T15:29:59.659 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap purge testimg2 2023-12-06T15:30:00.389 INFO:tasks.workunit.client.0.smithi123.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-12-06T15:30:00.399 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap purge testimg3 2023-12-06T15:30:01.393 INFO:tasks.workunit.client.0.smithi123.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-12-06T15:30:01.403 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm testimg2 2023-12-06T15:30:01.525 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete... Removing image: 100% complete...done. 2023-12-06T15:30:01.528 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm testimg3 2023-12-06T15:30:01.622 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete...2023-12-06T15:30:01.622+0000 7f37c86ea700 0 -- 172.21.15.123:0/4075242668 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x556925e2dea0 msgr2=0x556925ed4110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:30:01.624 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:30:01.627 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap protect testimg1@snap1 2023-12-06T15:30:01.666 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd clone testimg1@snap1 testimg2 2023-12-06T15:30:01.731 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create testimg2@snap2 2023-12-06T15:30:02.399 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:30:02.408 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd deep copy --flatten testimg2 testimg3 2023-12-06T15:30:03.563 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:30:03.563+0000 7f06d9ddf700 0 -- 172.21.15.123:0/2662222173 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7f06b40066f0 msgr2=0x7f06b4008b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:30:03.643 INFO:tasks.workunit.client.0.smithi123.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete...2023-12-06T15:30:03.643+0000 7f06d9ddf700 0 -- 172.21.15.123:0/2662222173 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7f06bc0371d0 msgr2=0x7f06bc0395c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:30:04.234 INFO:tasks.workunit.client.0.smithi123.stderr: Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-12-06T15:30:04.238 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info testimg3 2023-12-06T15:30:04.238 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'size 256 MiB' 2023-12-06T15:30:04.270 INFO:tasks.workunit.client.0.smithi123.stdout: size 256 MiB in 64 objects 2023-12-06T15:30:04.270 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info testimg3 2023-12-06T15:30:04.271 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -v parent: 2023-12-06T15:30:04.303 INFO:tasks.workunit.client.0.smithi123.stdout:rbd image 'testimg3': 2023-12-06T15:30:04.303 INFO:tasks.workunit.client.0.smithi123.stdout: size 256 MiB in 64 objects 2023-12-06T15:30:04.303 INFO:tasks.workunit.client.0.smithi123.stdout: order 22 (4 MiB objects) 2023-12-06T15:30:04.303 INFO:tasks.workunit.client.0.smithi123.stdout: snapshot_count: 1 2023-12-06T15:30:04.303 INFO:tasks.workunit.client.0.smithi123.stdout: id: 26e7d7ffa610 2023-12-06T15:30:04.303 INFO:tasks.workunit.client.0.smithi123.stdout: block_name_prefix: rbd_data.26e7d7ffa610 2023-12-06T15:30:04.303 INFO:tasks.workunit.client.0.smithi123.stdout: format: 2 2023-12-06T15:30:04.303 INFO:tasks.workunit.client.0.smithi123.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 2023-12-06T15:30:04.303 INFO:tasks.workunit.client.0.smithi123.stdout: op_features: 2023-12-06T15:30:04.303 INFO:tasks.workunit.client.0.smithi123.stdout: flags: 2023-12-06T15:30:04.303 INFO:tasks.workunit.client.0.smithi123.stdout: create_timestamp: Wed Dec 6 15:30:02 2023 2023-12-06T15:30:04.303 INFO:tasks.workunit.client.0.smithi123.stdout: access_timestamp: Wed Dec 6 15:30:02 2023 2023-12-06T15:30:04.304 INFO:tasks.workunit.client.0.smithi123.stdout: modify_timestamp: Wed Dec 6 15:30:02 2023 2023-12-06T15:30:04.304 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap ls testimg3 2023-12-06T15:30:04.304 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -v SNAPID 2023-12-06T15:30:04.304 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:30:04.304 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 1 2023-12-06T15:30:04.335 INFO:tasks.workunit.client.0.smithi123.stdout:1 2023-12-06T15:30:04.336 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap ls testimg3 2023-12-06T15:30:04.336 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '.*snap2.*' 2023-12-06T15:30:04.367 INFO:tasks.workunit.client.0.smithi123.stdout: 80 snap2 256 MiB Wed Dec 6 15:30:03 2023 2023-12-06T15:30:04.368 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd info testimg2 2023-12-06T15:30:04.368 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'features:.*deep-flatten' 2023-12-06T15:30:04.408 INFO:tasks.workunit.client.0.smithi123.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 2023-12-06T15:30:04.409 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd flatten testimg2 2023-12-06T15:30:04.454 INFO:tasks.workunit.client.0.smithi123.stderr: Image flatten: 1% complete... Image flatten: 3% complete... Image flatten: 4% complete... Image flatten: 6% complete... Image flatten: 7% complete... Image flatten: 9% complete... Image flatten: 10% complete... Image flatten: 12% complete... Image flatten: 14% complete... Image flatten: 15% complete... Image flatten: 17% complete... Image flatten: 18% complete... Image flatten: 20% complete... Image flatten: 21% complete... Image flatten: 23% complete... Image flatten: 25% complete... Image flatten: 26% complete... Image flatten: 28% complete... Image flatten: 29% complete... Image flatten: 31% complete... Image flatten: 32% complete... Image flatten: 34% complete... Image flatten: 35% complete... Image flatten: 37% complete... Image flatten: 39% complete... Image flatten: 40% complete... Image flatten: 42% complete... Image flatten: 43% complete... Image flatten: 45% complete... Image flatten: 46% complete... Image flatten: 48% complete... Image flatten: 50% complete... Image flatten: 51% complete... Image flatten: 53% complete... Image flatten: 54% complete... Image flatten: 56% complete... Image flatten: 57% complete... Image flatten: 59% complete... Image flatten: 60% complete... Image flatten: 62% complete... Image flatten: 64% complete... Image flatten: 65% complete... Image flatten: 67% complete... Image flatten: 68% complete... Image flatten: 70% complete... Image flatten: 71% complete... Image flatten: 73% complete... Image flatten: 75% complete... Image flatten: 76% complete... Image flatten: 78% complete... Image flatten: 79% complete... Image flatten: 81% complete... Image flatten: 82% complete... Image flatten: 84% complete... Image flatten: 85% complete... Image flatten: 87% complete... Image flatten: 89% complete... Image flatten: 90% complete... Image flatten: 92% complete... Image flatten: 93% complete... Image flatten: 95% complete... Image flatten: 96% complete... Image flatten: 98% complete... Image flatten: 100% complete...done. 2023-12-06T15:30:04.461 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap unprotect testimg1@snap1 2023-12-06T15:30:04.503 INFO:tasks.workunit.client.0.smithi123.stderr:+ remove_images 2023-12-06T15:30:04.503 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:05.542 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:06.536 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:07.644 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:07.727 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:07.805 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:07.883 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:07.961 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:08.038 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:08.118 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:08.197 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:08.482 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:08.559 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:08.637 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:08.718 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:08.797 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:08.876 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:08.957 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:09.036 INFO:tasks.workunit.client.0.smithi123.stderr:+ test_clone_v2 2023-12-06T15:30:09.036 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 'testing clone v2...' 2023-12-06T15:30:09.037 INFO:tasks.workunit.client.0.smithi123.stdout:testing clone v2... 2023-12-06T15:30:09.037 INFO:tasks.workunit.client.0.smithi123.stderr:+ remove_images 2023-12-06T15:30:09.037 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:09.116 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:09.195 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:09.274 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:09.352 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:09.431 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:09.508 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:09.587 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:09.666 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:09.743 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:09.825 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:09.902 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:09.980 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:10.059 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:10.138 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:10.216 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:10.294 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:10.374 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:10.455 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 -s 1 test1 2023-12-06T15:30:10.498 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create test1@1 2023-12-06T15:30:10.606 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:30:10.613 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd clone --rbd-default-clone-format=1 test1@1 test2 2023-12-06T15:30:10.649 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:30:10.649+0000 7f2d26961700 -1 librbd::image::CloneRequest: 0x560439313aa0 validate_parent: parent snapshot must be protected 2023-12-06T15:30:10.649 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: clone error: (22) Invalid argument 2023-12-06T15:30:10.651 INFO:tasks.workunit.client.0.smithi123.stderr:+ true 2023-12-06T15:30:10.651 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd clone --rbd-default-clone-format=2 test1@1 test2 2023-12-06T15:30:10.718 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd clone --rbd-default-clone-format=2 test1@1 test3 2023-12-06T15:30:10.790 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap protect test1@1 2023-12-06T15:30:10.831 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd clone --rbd-default-clone-format=1 test1@1 test4 2023-12-06T15:30:10.899 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd children test1@1 2023-12-06T15:30:10.899 INFO:tasks.workunit.client.0.smithi123.stderr:+ sort 2023-12-06T15:30:10.899 INFO:tasks.workunit.client.0.smithi123.stderr:+ tr '\n' ' ' 2023-12-06T15:30:10.899 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -E 'test2.*test3.*test4' 2023-12-06T15:30:10.938 INFO:tasks.workunit.client.0.smithi123.stdout:rbd/test2 rbd/test3 rbd/test4 2023-12-06T15:30:10.939 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd children --descendants test1 2023-12-06T15:30:10.939 INFO:tasks.workunit.client.0.smithi123.stderr:+ sort 2023-12-06T15:30:10.939 INFO:tasks.workunit.client.0.smithi123.stderr:+ tr '\n' ' ' 2023-12-06T15:30:10.939 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -E 'test2.*test3.*test4' 2023-12-06T15:30:10.988 INFO:tasks.workunit.client.0.smithi123.stdout:rbd/test2 rbd/test3 rbd/test4 2023-12-06T15:30:10.989 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd remove test4 2023-12-06T15:30:11.098 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:30:11.101 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap unprotect test1@1 2023-12-06T15:30:11.142 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap remove test1@1 2023-12-06T15:30:11.183 INFO:tasks.workunit.client.0.smithi123.stderr: Removing snap: 100% complete...done. 2023-12-06T15:30:11.192 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap list --all test1 2023-12-06T15:30:11.192 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep -E 'trash \(1\) *$' 2023-12-06T15:30:11.226 INFO:tasks.workunit.client.0.smithi123.stdout: 84 0424bd2f-e03e-42ad-93e4-7c923f755850 1 MiB Wed Dec 6 15:30:10 2023 trash (1) 2023-12-06T15:30:11.226 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create test1@2 2023-12-06T15:30:11.603 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:30:11.612 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test1 2023-12-06T15:30:11.612 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'image has snapshots' 2023-12-06T15:30:11.666 INFO:tasks.workunit.client.0.smithi123.stdout:rbd: image has snapshots - these must be deleted with 'rbd snap purge' before the image can be removed. 2023-12-06T15:30:11.666 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap rm test1@2 2023-12-06T15:30:12.602 INFO:tasks.workunit.client.0.smithi123.stderr: Removing snap: 100% complete...done. 2023-12-06T15:30:12.617 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test1 2023-12-06T15:30:12.617 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'linked clones' 2023-12-06T15:30:12.678 INFO:tasks.workunit.client.0.smithi123.stdout:rbd: image has snapshots with linked clones - these must be deleted or flattened before the image can be removed. 2023-12-06T15:30:12.678 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test3 2023-12-06T15:30:12.781 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:30:12.781+0000 7f307d876700 0 -- 172.21.15.123:0/223761771 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x560f204034d0 msgr2=0x560f204a7f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:30:12.791 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:30:12.794 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test1 2023-12-06T15:30:12.794 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep 'linked clones' 2023-12-06T15:30:12.849 INFO:tasks.workunit.client.0.smithi123.stdout:rbd: image has snapshots with linked clones - these must be deleted or flattened before the image can be removed. 2023-12-06T15:30:12.849 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd flatten test2 2023-12-06T15:30:13.621 INFO:tasks.workunit.client.0.smithi123.stderr: Image flatten: 100% complete...done. 2023-12-06T15:30:13.632 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap list --all test1 2023-12-06T15:30:13.632 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:30:13.632 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^0$' 2023-12-06T15:30:13.668 INFO:tasks.workunit.client.0.smithi123.stdout:0 2023-12-06T15:30:13.668 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test1 2023-12-06T15:30:13.775 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:30:13.778 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test2 2023-12-06T15:30:13.887 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:30:13.887+0000 7fca71e2b700 0 -- 172.21.15.123:0/2991358951 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x55bd7c903560 msgr2=0x55bd7c8dcc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:30:13.888 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:30:13.890 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 -s 1 test1 2023-12-06T15:30:13.933 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create test1@1 2023-12-06T15:30:14.611 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:30:14.620 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap create test1@2 2023-12-06T15:30:15.620 INFO:tasks.workunit.client.0.smithi123.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T15:30:15.630 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd clone test1@1 test2 --rbd-default-clone-format 2 2023-12-06T15:30:15.706 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd clone test1@2 test3 --rbd-default-clone-format 2 2023-12-06T15:30:15.785 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap rm test1@1 2023-12-06T15:30:15.825 INFO:tasks.workunit.client.0.smithi123.stderr: Removing snap: 100% complete...done. 2023-12-06T15:30:15.833 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd snap rm test1@2 2023-12-06T15:30:15.872 INFO:tasks.workunit.client.0.smithi123.stderr: Removing snap: 100% complete...done. 2023-12-06T15:30:15.880 INFO:tasks.workunit.client.0.smithi123.stderr:+ expect_fail rbd rm test1 2023-12-06T15:30:15.880 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test1 2023-12-06T15:30:15.925 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:30:15.924+0000 7f17f0080380 -1 librbd::api::Image: remove: image has snapshots - not removing 2023-12-06T15:30:15.925 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 0% complete...failed. 2023-12-06T15:30:15.931 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: image has snapshots with linked clones - these must be deleted or flattened before the image can be removed. 2023-12-06T15:30:15.934 INFO:tasks.workunit.client.0.smithi123.stderr:+ return 0 2023-12-06T15:30:15.934 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test1 --rbd-move-parent-to-trash-on-remove=true 2023-12-06T15:30:16.006 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:30:16.009 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls -a 2023-12-06T15:30:16.009 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep test1 2023-12-06T15:30:16.036 INFO:tasks.workunit.client.0.smithi123.stdout:281ca2727c1e test1 2023-12-06T15:30:16.036 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test2 2023-12-06T15:30:16.135 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:30:16.135+0000 7f2d90925700 0 -- 172.21.15.123:0/2408101373 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x55a9efa90600 msgr2=0x55a9efb31130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:30:16.613 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:30:16.613+0000 7f2d90925700 0 -- 172.21.15.123:0/2408101373 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7f2d700366f0 msgr2=0x7f2d70038b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:30:16.646 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:30:16.649 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls -a 2023-12-06T15:30:16.650 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep test1 2023-12-06T15:30:16.678 INFO:tasks.workunit.client.0.smithi123.stdout:281ca2727c1e test1 2023-12-06T15:30:16.678 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test3 2023-12-06T15:30:16.779 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:30:16.779+0000 7f5d1c028700 0 -- 172.21.15.123:0/1361504516 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x5615d3b19600 msgr2=0x5615d3bba030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:30:17.613 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:30:17.613+0000 7f5d1c028700 0 -- 172.21.15.123:0/1361504516 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7f5cfc036890 msgr2=0x7f5cfc038cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T15:30:17.678 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:30:17.682 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd trash ls -a 2023-12-06T15:30:17.682 INFO:tasks.workunit.client.0.smithi123.stderr:+ expect_fail grep test1 2023-12-06T15:30:17.682 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep test1 2023-12-06T15:30:17.710 INFO:tasks.workunit.client.0.smithi123.stderr:+ return 0 2023-12-06T15:30:17.710 INFO:tasks.workunit.client.0.smithi123.stderr:+ test_thick_provision 2023-12-06T15:30:17.710 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 'testing thick provision...' 2023-12-06T15:30:17.711 INFO:tasks.workunit.client.0.smithi123.stdout:testing thick provision... 2023-12-06T15:30:17.711 INFO:tasks.workunit.client.0.smithi123.stderr:+ remove_images 2023-12-06T15:30:17.711 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:17.791 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:17.869 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:17.948 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:18.028 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:18.109 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:18.187 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:18.273 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:18.354 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:18.435 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:18.516 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:18.594 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:18.673 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:18.752 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:18.831 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:18.912 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:18.993 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:19.073 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:19.154 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 --thick-provision -s 64M test1 2023-12-06T15:30:19.471 INFO:tasks.workunit.client.0.smithi123.stderr: Thick provisioning: 6% complete... Thick provisioning: 12% complete... Thick provisioning: 18% complete... Thick provisioning: 25% complete... Thick provisioning: 31% complete... Thick provisioning: 37% complete... Thick provisioning: 43% complete... Thick provisioning: 50% complete... Thick provisioning: 56% complete... Thick provisioning: 62% complete... Thick provisioning: 68% complete... Thick provisioning: 75% complete... Thick provisioning: 81% complete... Thick provisioning: 87% complete... Thick provisioning: 93% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2023-12-06T15:30:19.500 INFO:tasks.workunit.client.0.smithi123.stderr:+ count=0 2023-12-06T15:30:19.500 INFO:tasks.workunit.client.0.smithi123.stderr:+ ret= 2023-12-06T15:30:19.500 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 0 -lt 10 ']' 2023-12-06T15:30:19.500 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd du 2023-12-06T15:30:19.500 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep test1 2023-12-06T15:30:19.500 INFO:tasks.workunit.client.0.smithi123.stderr:+ tr -s ' ' 2023-12-06T15:30:19.500 INFO:tasks.workunit.client.0.smithi123.stderr:+ cut -d ' ' -f 4-5 2023-12-06T15:30:19.501 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^64 MiB' 2023-12-06T15:30:19.735 INFO:tasks.workunit.client.0.smithi123.stdout:64 MiB 2023-12-06T15:30:19.735 INFO:tasks.workunit.client.0.smithi123.stderr:+ ret=0 2023-12-06T15:30:19.735 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 0 = 0 ']' 2023-12-06T15:30:19.735 INFO:tasks.workunit.client.0.smithi123.stderr:+ break 2023-12-06T15:30:19.735 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd du 2023-12-06T15:30:19.766 INFO:tasks.workunit.client.0.smithi123.stdout:NAME PROVISIONED USED 2023-12-06T15:30:19.766 INFO:tasks.workunit.client.0.smithi123.stdout:test1 64 MiB 64 MiB 2023-12-06T15:30:19.769 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 0 '!=' 0 ']' 2023-12-06T15:30:19.769 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test1 2023-12-06T15:30:19.882 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 6% complete... Removing image: 12% complete... Removing image: 18% complete... Removing image: 25% complete... Removing image: 31% complete... Removing image: 37% complete... Removing image: 43% complete... Removing image: 50% complete... Removing image: 56% complete... Removing image: 62% complete... Removing image: 68% complete... Removing image: 75% complete... Removing image: 81% complete... Removing image: 87% complete... Removing image: 93% complete...2023-12-06T15:30:19.881+0000 7fa5b1bed700 0 -- 172.21.15.123:0/4145621929 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x560664dc4ea0 msgr2=0x560664e68ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:30:19.914 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 100% complete...done. 2023-12-06T15:30:19.917 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:30:19.917 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep test1 2023-12-06T15:30:19.917 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:30:19.917 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^0$' 2023-12-06T15:30:19.943 INFO:tasks.workunit.client.0.smithi123.stdout:0 2023-12-06T15:30:19.943 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 --thick-provision -s 4G test1 2023-12-06T15:30:20.451 INFO:tasks.workunit.client.0.smithi123.stderr: Thick provisioning: 1% complete... Thick provisioning: 2% complete... Thick provisioning: 3% complete... Thick provisioning: 4% complete... Thick provisioning: 5% complete...2023-12-06T15:30:20.449+0000 7f56cd89d700 0 -- 172.21.15.123:0/2232258927 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x55558239fb00 msgr2=0x5555823af6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:30:20.525 INFO:tasks.workunit.client.0.smithi123.stderr: Thick provisioning: 6% complete...2023-12-06T15:30:20.524+0000 7f56cd09c700 0 -- 172.21.15.123:0/2232258927 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x5555823f7f10 msgr2=0x5555823fa360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:30:30.328 INFO:tasks.workunit.client.0.smithi123.stderr: Thick provisioning: 7% complete... Thick provisioning: 8% complete... Thick provisioning: 9% complete... Thick provisioning: 10% complete... Thick provisioning: 11% complete... Thick provisioning: 12% complete... Thick provisioning: 13% complete... Thick provisioning: 14% complete... Thick provisioning: 15% complete... Thick provisioning: 16% complete... Thick provisioning: 17% complete... Thick provisioning: 18% complete... Thick provisioning: 19% complete... Thick provisioning: 20% complete... Thick provisioning: 21% complete... Thick provisioning: 22% complete... Thick provisioning: 23% complete... Thick provisioning: 24% complete... Thick provisioning: 25% complete... Thick provisioning: 26% complete... Thick provisioning: 27% complete... Thick provisioning: 28% complete... Thick provisioning: 29% complete... Thick provisioning: 30% complete... Thick provisioning: 31% complete... Thick provisioning: 32% complete... Thick provisioning: 33% complete... Thick provisioning: 34% complete... Thick provisioning: 35% complete... Thick provisioning: 36% complete... Thick provisioning: 37% complete... Thick provisioning: 38% complete... Thick provisioning: 39% complete... Thick provisioning: 40% complete... Thick provisioning: 41% complete... Thick provisioning: 42% complete... Thick provisioning: 43% complete... Thick provisioning: 44% complete... Thick provisioning: 45% complete... Thick provisioning: 46% complete... Thick provisioning: 47% complete... Thick provisioning: 48% complete... Thick provisioning: 49% complete... Thick provisioning: 50% complete... Thick provisioning: 51% complete... Thick provisioning: 52% complete... Thick provisioning: 53% complete... Thick provisioning: 54% complete... Thick provisioning: 55% complete... Thick provisioning: 56% complete... Thick provisioning: 57% complete... Thick provisioning: 58% complete... Thick provisioning: 59% complete... Thick provisioning: 60% complete... Thick provisioning: 61% complete... Thick provisioning: 62% complete... Thick provisioning: 63% complete... Thick provisioning: 64% complete... Thick provisioning: 65% complete... Thick provisioning: 66% complete... Thick provisioning: 67% complete... Thick provisioning: 68% complete... Thick provisioning: 69% complete... Thick provisioning: 70% complete... Thick provisioning: 71% complete... Thick provisioning: 72% complete... Thick provisioning: 73% complete... Thick provisioning: 74% complete... Thick provisioning: 75% complete... Thick provisioning: 76% complete... Thick provisioning: 77% complete... Thick provisioning: 78% complete... Thick provisioning: 79% complete... Thick provisioning: 80% complete... Thick provisioning: 81% complete... Thick provisioning: 82% complete... Thick provisioning: 83% complete... Thick provisioning: 84% complete... Thick provisioning: 85% complete... Thick provisioning: 86% complete... Thick provisioning: 87% complete... Thick provisioning: 88% complete... Thick provisioning: 89% complete... Thick provisioning: 90% complete... Thick provisioning: 91% complete... Thick provisioning: 92% complete... Thick provisioning: 93% complete... Thick provisioning: 94% complete... Thick provisioning: 95% complete... Thick provisioning: 96% complete... Thick provisioning: 97% complete... Thick provisioning: 98% complete... Thick provisioning: 99% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2023-12-06T15:30:30.339 INFO:tasks.workunit.client.0.smithi123.stderr:+ count=0 2023-12-06T15:30:30.340 INFO:tasks.workunit.client.0.smithi123.stderr:+ ret= 2023-12-06T15:30:30.340 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 0 -lt 10 ']' 2023-12-06T15:30:30.340 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd du 2023-12-06T15:30:30.340 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep test1 2023-12-06T15:30:30.340 INFO:tasks.workunit.client.0.smithi123.stderr:+ tr -s ' ' 2023-12-06T15:30:30.340 INFO:tasks.workunit.client.0.smithi123.stderr:+ cut -d ' ' -f 4-5 2023-12-06T15:30:30.340 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^4 GiB' 2023-12-06T15:30:30.572 INFO:tasks.workunit.client.0.smithi123.stdout:4 GiB 2023-12-06T15:30:30.573 INFO:tasks.workunit.client.0.smithi123.stderr:+ ret=0 2023-12-06T15:30:30.573 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 0 = 0 ']' 2023-12-06T15:30:30.573 INFO:tasks.workunit.client.0.smithi123.stderr:+ break 2023-12-06T15:30:30.573 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd du 2023-12-06T15:30:30.603 INFO:tasks.workunit.client.0.smithi123.stdout:NAME PROVISIONED USED 2023-12-06T15:30:30.603 INFO:tasks.workunit.client.0.smithi123.stdout:test1 4 GiB 4 GiB 2023-12-06T15:30:30.605 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 0 '!=' 0 ']' 2023-12-06T15:30:30.605 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd rm test1 2023-12-06T15:30:30.720 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 1% complete... Removing image: 2% complete...2023-12-06T15:30:30.720+0000 7f82d0705700 0 -- 172.21.15.123:0/2809357561 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x55f2341ae4e0 msgr2=0x55f2341d04f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:30:30.738 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 3% complete... Removing image: 4% complete...2023-12-06T15:30:30.738+0000 7f82d0f06700 0 -- 172.21.15.123:0/2809357561 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x55f23409f700 msgr2=0x55f2341450e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T15:30:31.671 INFO:tasks.workunit.client.0.smithi123.stderr: Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2023-12-06T15:30:31.674 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd ls 2023-12-06T15:30:31.674 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep test1 2023-12-06T15:30:31.674 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:30:31.674 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^0$' 2023-12-06T15:30:31.699 INFO:tasks.workunit.client.0.smithi123.stdout:0 2023-12-06T15:30:31.700 INFO:tasks.workunit.client.0.smithi123.stderr:+ test_namespace 2023-12-06T15:30:31.700 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 'testing namespace...' 2023-12-06T15:30:31.700 INFO:tasks.workunit.client.0.smithi123.stdout:testing namespace... 2023-12-06T15:30:31.701 INFO:tasks.workunit.client.0.smithi123.stderr:+ remove_images 2023-12-06T15:30:31.701 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:31.781 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:31.863 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:31.945 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:32.028 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:32.109 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:32.193 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:32.274 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:32.357 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:32.440 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:32.523 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:32.608 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:32.689 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:32.771 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:32.851 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:32.933 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:33.016 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:33.098 INFO:tasks.workunit.client.0.smithi123.stderr:+ for img in $IMGS 2023-12-06T15:30:33.181 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd namespace ls 2023-12-06T15:30:33.181 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:30:33.181 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^0$' 2023-12-06T15:30:33.207 INFO:tasks.workunit.client.0.smithi123.stdout:0 2023-12-06T15:30:33.207 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd namespace create rbd/test1 2023-12-06T15:30:33.240 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd namespace create --pool rbd --namespace test2 2023-12-06T15:30:33.280 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd namespace create --namespace test3 2023-12-06T15:30:33.314 INFO:tasks.workunit.client.0.smithi123.stderr:+ expect_fail rbd namespace create rbd/test3 2023-12-06T15:30:33.314 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd namespace create rbd/test3 2023-12-06T15:30:33.345 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: failed to created namespace: (17) File exists 2023-12-06T15:30:33.345 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:30:33.344+0000 7f40988dd380 -1 librbd::api::Namespace: create: failed to add namespace: (17) File exists 2023-12-06T15:30:33.347 INFO:tasks.workunit.client.0.smithi123.stderr:+ return 0 2023-12-06T15:30:33.347 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd namespace list 2023-12-06T15:30:33.347 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep test 2023-12-06T15:30:33.347 INFO:tasks.workunit.client.0.smithi123.stderr:+ wc -l 2023-12-06T15:30:33.347 INFO:tasks.workunit.client.0.smithi123.stderr:+ grep '^3$' 2023-12-06T15:30:33.373 INFO:tasks.workunit.client.0.smithi123.stdout:3 2023-12-06T15:30:33.373 INFO:tasks.workunit.client.0.smithi123.stderr:+ expect_fail rbd namespace remove --pool rbd missing 2023-12-06T15:30:33.373 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd namespace remove --pool rbd missing 2023-12-06T15:30:33.394 INFO:tasks.workunit.client.0.smithi123.stderr:rbd: namespace name was not specified 2023-12-06T15:30:33.395 INFO:tasks.workunit.client.0.smithi123.stderr:+ return 0 2023-12-06T15:30:33.395 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd create --image-format 2 --size 1G rbd/test1/image1 2023-12-06T15:30:33.442 INFO:tasks.workunit.client.0.smithi123.stderr:+ rbd bench --io-type write --io-pattern rand --io-total 32M --io-size 4K rbd/test1/image1 2023-12-06T15:30:33.488 INFO:tasks.workunit.client.0.smithi123.stdout:bench type write io_size 4096 io_threads 16 bytes 33554432 pattern random 2023-12-06T15:30:33.847 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:30:33.845+0000 7fa2aa2ce700 0 -- 172.21.15.123:0/1871504539 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x5638b44c5610 msgr2=0x5638b44daf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:30:34.494 INFO:tasks.workunit.client.0.smithi123.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T15:30:34.494 INFO:tasks.workunit.client.0.smithi123.stdout: 1 3392 3391.12 13 MiB/s 2023-12-06T15:30:34.735 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:30:34.735+0000 7fa2aa2ce700 0 -- 172.21.15.123:0/1871504539 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7fa28c036750 msgr2=0x7fa28c038b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T15:30:34.738 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T15:30:34.738+0000 7fa2aa2ce700 0 -- 172.21.15.123:0/1871504539 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x5638b44c5610 msgr2=0x7fa28c03b1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T15:31:04.365 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:04.364+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.10575.0:339 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 823296~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:04.783 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:04.781+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:05.341 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:05.340+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:05.795 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:05.794+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:06.366 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:06.365+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:06.808 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:06.807+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:07.363 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:07.361+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:07.822 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:07.820+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:08.396 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:08.395+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:08.863 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:08.861+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:09.365 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:09.364+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:09.862 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:09.860+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:10.354 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:10.352+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:10.911 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:10.910+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:11.342 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:11.342+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:11.887 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:11.887+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:12.307 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:12.306+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:12.927 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:12.926+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:13.296 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:13.295+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:13.973 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:13.973+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:14.295 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:14.295+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:15.018 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:15.017+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:15.261 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:15.261+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:16.063 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:16.063+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:16.281 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:16.280+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:17.030 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:17.029+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:17.243 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:17.243+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:18.072 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:18.071+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:18.229 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:18.229+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:19.086 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:19.086+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:19.185 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:19.185+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:20.061 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:20.060+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:20.223 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:20.222+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:21.059 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:21.058+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:21.262 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:21.261+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:22.103 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:22.103+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:22.247 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:22.246+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:23.077 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:23.077+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:23.217 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:23.216+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:24.045 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:24.045+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:24.246 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:24.245+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:25.063 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:25.063+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:25.272 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:25.271+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:26.048 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:26.047+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:26.266 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:26.265+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:27.021 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:27.021+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:27.219 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:27.218+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:28.041 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:28.040+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:28.264 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:28.264+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:29.090 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:29.090+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:29.271 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:29.271+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:30.125 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:30.125+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:30.235 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:30.235+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:31.163 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:31.163+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:31.275 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:31.275+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:32.127 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:32.127+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:32.270 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:32.269+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:33.151 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:33.150+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:33.290 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:33.289+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:34.147 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:34.146+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:34.278 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:34.277+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:35.187 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:35.186+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:35.314 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:35.314+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:36.176 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:36.176+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:36.281 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:36.280+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:37.173 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:37.172+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:37.270 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:37.269+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:38.163 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:38.162+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:38.313 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:38.312+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:39.203 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:39.202+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:39.289 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:39.288+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:40.210 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:40.210+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:40.299 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:40.299+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:41.248 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:41.247+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:41.331 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:41.331+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:42.237 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:42.236+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:42.300 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:42.299+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:43.204 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:43.203+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:43.303 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:43.303+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:44.206 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:44.206+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:44.256 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:44.256+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:45.204 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:45.202+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:45.245 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:45.243+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:46.203 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:46.202+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:46.273 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:46.272+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:47.214 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:47.212+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:47.230 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:47.229+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:48.187 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:48.186+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:48.258 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:48.257+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:49.218 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:49.216+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:49.280 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:49.278+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:50.170 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:50.169+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:50.282 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:50.280+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:51.207 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:51.206+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:51.300 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:51.298+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:52.191 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:52.190+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:52.267 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:52.265+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:53.152 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:53.150+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:53.288 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:53.287+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:54.129 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:54.129+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:54.333 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:54.333+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:55.128 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:55.127+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:55.295 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:55.295+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:56.093 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:56.092+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:56.334 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:56.333+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:57.055 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:57.055+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:57.333 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:57.333+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:58.074 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:58.073+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:58.293 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:58.292+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:31:59.119 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:31:59.118+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:31:59.317 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:31:59.316+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:00.093 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:00.093+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:00.316 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:00.315+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:01.084 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:01.083+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:01.294 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:01.293+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:02.065 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:02.065+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:02.331 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:02.331+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:03.029 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:03.029+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:03.344 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:03.343+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:04.064 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:04.063+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:04.322 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:04.321+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:05.062 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:05.061+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:05.342 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:05.341+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:06.068 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:06.067+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:06.338 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:06.337+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:07.110 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:07.110+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:07.291 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:07.290+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:08.157 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:08.157+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:08.257 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:08.256+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:09.179 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:09.178+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:09.290 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:09.289+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:10.139 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:10.139+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:10.291 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:10.291+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:11.163 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:11.163+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:11.323 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:11.323+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:12.154 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:12.154+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:12.339 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:12.338+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:13.128 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:13.127+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:13.362 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:13.362+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:14.163 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:14.162+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:14.365 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:14.364+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:15.150 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:15.149+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:15.354 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:15.353+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:16.126 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:16.126+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:16.363 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:16.362+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:17.089 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:17.089+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:17.332 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:17.331+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:18.059 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:18.058+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:18.289 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:18.289+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:19.053 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:19.053+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:19.301 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:19.300+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:20.038 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:20.037+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:20.329 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:20.328+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:21.053 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:21.053+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:21.305 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:21.304+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:22.023 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:22.022+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:22.312 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:22.311+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:22.982 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:22.981+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:23.298 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:23.298+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:24.014 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:24.014+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:24.292 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:24.291+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:25.052 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:25.052+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:25.290 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:25.289+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:26.053 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:26.052+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:26.305 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:26.304+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:27.089 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:27.088+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:27.311 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:27.309+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:28.097 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:28.096+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:28.313 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:28.311+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:29.110 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:29.108+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:29.358 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:29.356+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:30.081 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:30.080+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:30.320 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:30.318+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:31.103 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:31.102+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:31.300 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:31.298+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:32.130 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:32.128+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:32.293 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:32.292+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:33.114 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:33.112+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:33.315 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:33.314+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:34.148 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:34.146+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:34.349 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:34.347+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:35.133 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:35.132+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:35.381 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:35.379+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:36.108 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:36.106+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:36.341 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:36.341+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:37.068 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:37.068+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:37.314 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:37.313+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:38.038 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:38.037+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:38.316 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:38.315+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:39.066 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:39.066+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:39.339 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:39.338+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:40.057 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:40.056+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:40.322 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:40.322+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:41.008 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:41.008+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:41.287 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:41.286+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:42.029 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:42.028+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:42.314 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:42.314+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:43.029 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:43.029+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:43.293 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:43.292+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:44.076 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:44.075+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:44.276 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:44.275+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:45.071 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:45.070+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:45.310 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:45.309+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:46.051 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:46.050+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:46.318 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:46.317+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:47.086 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:47.085+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:47.351 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:47.350+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:48.089 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:48.088+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:48.314 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:48.313+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:49.044 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:49.043+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:49.300 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:49.300+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:50.046 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:50.046+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:50.327 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:50.326+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:51.036 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:51.035+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:51.291 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:51.290+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:52.021 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:52.021+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:52.254 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:52.253+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:52.996 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:52.996+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:53.253 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:53.253+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:54.045 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:54.044+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:54.302 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:54.301+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:55.016 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:55.015+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:55.351 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:55.350+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:55.994 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:55.993+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:56.313 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:56.312+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:57.006 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:57.006+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:57.300 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:57.299+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:57.959 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:57.959+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:58.296 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:58.295+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:58.927 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:58.926+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:32:59.340 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:32:59.339+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:32:59.897 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:32:59.896+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:00.386 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:00.386+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:00.938 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:00.938+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:01.398 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:01.397+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:01.988 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:01.987+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:02.366 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:02.365+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:02.980 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:02.979+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:03.334 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:03.334+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:03.984 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:03.983+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:04.368 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:04.368+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:05.025 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:05.024+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:05.343 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:05.342+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:06.068 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:06.068+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:06.304 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:06.304+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:07.059 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:07.058+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:07.354 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:07.353+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:08.083 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:08.082+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:08.334 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:08.334+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:09.125 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:09.124+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:09.287 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:09.287+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:10.094 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:10.092+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:10.320 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:10.319+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:11.102 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:11.101+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:11.301 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:11.299+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:12.068 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:12.067+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:12.331 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:12.330+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:13.046 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:13.044+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:13.319 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:13.317+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:14.001 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:13.999+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:14.366 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:14.364+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:15.051 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:15.050+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:15.320 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:15.318+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:16.081 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:16.079+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:16.299 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:16.297+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:17.036 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:17.034+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:17.271 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:17.270+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:18.074 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:18.073+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:18.292 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:18.290+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:19.048 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:19.047+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:19.282 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:19.281+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:20.025 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:20.024+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:20.285 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:20.285+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:21.063 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:21.062+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:21.335 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:21.334+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:22.020 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:22.019+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:22.351 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:22.350+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:23.053 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:23.052+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:23.370 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:23.370+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:24.009 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:24.008+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:24.351 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:24.350+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:24.994 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:24.994+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:25.336 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:25.336+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:26.038 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:26.037+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:26.386 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:26.385+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:27.005 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:27.004+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:27.339 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:27.338+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:28.034 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:28.034+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:28.330 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:28.329+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:29.067 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:29.066+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:29.311 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:29.311+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:30.019 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:30.018+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:30.325 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:30.325+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:31.012 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:31.011+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:31.283 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:31.283+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:32.013 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:32.012+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:32.283 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:32.282+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:32.989 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:32.988+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:33.294 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:33.293+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:34.026 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:34.025+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:34.322 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:34.321+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:34.978 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:34.977+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:35.346 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:35.345+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:35.967 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:35.966+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:36.340 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:36.339+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:36.962 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:36.961+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:37.300 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:37.299+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:37.960 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:37.959+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:38.268 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:38.267+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:38.952 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:38.951+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:39.303 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:39.301+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:39.922 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:39.921+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:40.336 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:40.335+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:40.910 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:40.909+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:41.319 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:41.319+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:41.948 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:41.947+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:42.301 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:42.300+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:42.906 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:42.905+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:43.274 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:43.273+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:43.919 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:43.918+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:44.293 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:44.293+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:44.888 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:44.888+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:45.300 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:45.299+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:45.913 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:45.912+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:46.292 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:46.291+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:46.959 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:46.958+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:47.320 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:47.319+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:47.964 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:47.963+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:48.335 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:48.335+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:48.977 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:48.976+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:49.322 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:49.321+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:49.984 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:49.983+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:50.346 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:50.345+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:51.019 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:51.018+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:51.323 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:51.322+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:51.979 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:51.979+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:52.279 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:52.278+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:52.939 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:52.937+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:53.306 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:53.305+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:53.919 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:53.917+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:54.345 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:54.343+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:54.921 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:54.919+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:55.327 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:55.325+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:55.909 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:55.907+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:56.301 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:56.299+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:56.944 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:56.942+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:57.333 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:57.331+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:57.977 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:57.975+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:58.383 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:58.382+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:58.956 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:58.954+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:33:59.407 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:33:59.405+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:33:59.995 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:33:59.993+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:00.413 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:00.412+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:01.015 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:01.014+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:01.368 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:01.366+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:01.999 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:01.998+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:02.406 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:02.405+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:02.968 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:02.967+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:03.417 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:03.416+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:03.996 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:03.995+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:04.377 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:04.376+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:05.041 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:05.040+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:05.355 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:05.354+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:06.068 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:06.067+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:06.354 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:06.353+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:07.094 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:07.093+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:07.375 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:07.374+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:08.082 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:08.082+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:08.355 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:08.354+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:09.067 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:09.066+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:09.356 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:09.355+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:10.059 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:10.058+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:10.352 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:10.352+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:11.093 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:11.092+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:11.402 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:11.401+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:12.061 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:12.060+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:12.405 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:12.404+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:13.035 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:13.034+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:13.432 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:13.430+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:14.001 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:14.000+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:14.440 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:14.439+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:14.980 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:14.980+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:15.404 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:15.404+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:15.953 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:15.952+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:16.398 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:16.397+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:16.935 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:16.934+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:17.362 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:17.361+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:17.906 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:17.905+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:18.389 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:18.388+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:18.927 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:18.926+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:19.401 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:19.400+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:19.904 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:19.903+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:20.431 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:20.430+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:20.927 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:20.926+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:21.479 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:21.478+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:21.921 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:21.920+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:22.441 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:22.440+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:22.890 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:22.889+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:23.430 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:23.430+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:23.900 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:23.899+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:24.395 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:24.394+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:24.869 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:24.868+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:25.377 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:25.376+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:25.913 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:25.912+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:26.425 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:26.424+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:26.866 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:26.865+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:27.474 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:27.473+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:27.859 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:27.858+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:28.426 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:28.426+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:28.820 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:28.819+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:29.411 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:29.410+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:29.835 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:29.834+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:30.365 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:30.364+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:30.791 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:30.791+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:31.411 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:31.410+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:31.763 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:31.762+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:32.392 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:32.391+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:32.751 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:32.750+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:33.350 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:33.350+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:33.739 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:33.738+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:34.342 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:34.341+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:34.773 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:34.772+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:35.361 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:35.359+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:35.745 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:35.743+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:36.373 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:36.371+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:36.734 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:36.732+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:37.421 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:37.419+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:37.732 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:37.730+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:38.441 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:38.439+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:38.777 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:38.775+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:39.434 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:39.432+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:39.733 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:39.731+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:40.403 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:40.401+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:40.737 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:40.735+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:41.381 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:41.379+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:41.784 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:41.782+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:42.404 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:42.402+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:42.768 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:42.766+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:43.368 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:43.367+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:43.741 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:43.739+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:44.326 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:44.325+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:44.703 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:44.702+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:45.347 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:45.347+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:45.658 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:45.657+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:46.323 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:46.322+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:46.702 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:46.701+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:47.274 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:47.273+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:47.720 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:47.719+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:48.236 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:48.235+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:48.758 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:48.757+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:49.188 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:49.187+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:49.737 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:49.734+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:50.144 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:50.143+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:50.716 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:50.715+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:51.174 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:51.173+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:51.729 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:51.728+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:52.217 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:52.216+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:52.758 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:52.757+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:53.245 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:53.244+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:53.766 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:53.765+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:54.262 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:54.261+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:54.809 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:54.808+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:55.260 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:55.259+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:55.828 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:55.827+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:56.298 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:56.297+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:56.802 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:56.801+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:57.288 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:57.287+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:57.789 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:57.788+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:58.331 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:58.330+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:58.782 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:58.781+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:34:59.360 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:34:59.359+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:34:59.792 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:34:59.791+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:00.354 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:00.353+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:00.766 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:00.765+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:01.308 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:01.307+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:01.723 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:01.722+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:02.323 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:02.322+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:02.752 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:02.751+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:03.345 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:03.344+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:03.783 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:03.782+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:04.378 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:04.377+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:04.818 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:04.817+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:05.330 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:05.329+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:05.832 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:05.831+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:06.289 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:06.288+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:06.816 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:06.815+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:07.326 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:07.325+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:07.835 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:07.834+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:08.297 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:08.296+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:08.843 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:08.842+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:09.284 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:09.283+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:09.804 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:09.803+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:10.260 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:10.259+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:10.765 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:10.764+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:11.281 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:11.280+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:11.736 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:11.735+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:12.317 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:12.316+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:12.718 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:12.717+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:13.307 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:13.306+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:13.759 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:13.758+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:14.308 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:14.307+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:14.746 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:14.745+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:15.307 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:15.306+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:15.740 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:15.739+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:16.281 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:16.280+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:16.738 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:16.737+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:17.297 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:17.296+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:17.742 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:17.741+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:18.269 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:18.267+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:18.740 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:18.738+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:19.302 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:19.300+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:19.755 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:19.753+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:20.275 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:20.273+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:20.772 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:20.770+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:21.232 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:21.230+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:21.822 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:21.820+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:22.184 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:22.182+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:22.826 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:22.824+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:23.222 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:23.220+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:23.834 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:23.831+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:24.232 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:24.230+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:24.790 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:24.788+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:25.248 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:25.246+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:25.838 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:25.836+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:26.255 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:26.253+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:26.793 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:26.791+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:27.253 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:27.251+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:27.773 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:27.772+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:28.210 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:28.209+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:28.786 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:28.785+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:29.238 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:29.237+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:29.758 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:29.757+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:30.247 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:30.246+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:30.757 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:30.756+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:31.279 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:31.278+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:31.716 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:31.715+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:32.274 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:32.273+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:32.762 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:32.761+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:33.241 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:33.240+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:33.786 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:33.784+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:34.192 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:34.191+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:34.786 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:34.785+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:35.228 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:35.227+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:35.824 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:35.823+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:36.180 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:36.179+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:36.871 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:36.870+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:37.166 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:37.165+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:37.887 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:37.886+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:38.194 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:38.193+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:38.840 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:38.839+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:39.193 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:39.192+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:39.835 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:39.834+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:40.160 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:40.158+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:40.800 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:40.798+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:41.133 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:41.132+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:41.808 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:41.806+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:42.161 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:42.159+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:42.801 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:42.800+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:43.159 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:43.158+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:43.790 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:43.789+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:44.207 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:44.205+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:44.763 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:44.762+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:45.165 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:45.164+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:45.724 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:45.723+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:46.122 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:46.121+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:46.747 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:46.746+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:47.164 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:47.163+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:47.707 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:47.706+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:48.148 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:48.147+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:48.711 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:48.710+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:49.117 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:49.116+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:49.703 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:49.702+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:50.113 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:50.111+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:50.667 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:50.666+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:51.064 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:51.063+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:51.683 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:51.682+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:52.072 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:52.071+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:52.693 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:52.692+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:53.084 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:53.083+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:53.696 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:53.695+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:54.077 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:54.076+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:54.716 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:54.714+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:55.058 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:55.057+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:55.716 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:55.715+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:56.092 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:56.091+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:56.720 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:56.719+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:57.098 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:57.097+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:57.672 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:57.671+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:58.078 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:58.077+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:58.712 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:58.710+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:35:59.072 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:35:59.071+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:35:59.694 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:35:59.692+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:00.121 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:00.120+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:00.725 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:00.723+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:01.097 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:01.095+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:01.759 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:01.757+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:02.131 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:02.129+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:02.808 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:02.806+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:03.098 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:03.096+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:03.828 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:03.826+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:04.144 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:04.142+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:04.875 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:04.873+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:05.133 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:05.131+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:05.910 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:05.908+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:06.094 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:06.092+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:06.952 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:06.950+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:07.059 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:07.057+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:07.909 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:07.907+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:08.077 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:08.075+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:08.879 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:08.877+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:09.050 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:09.048+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:09.850 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:09.848+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:10.069 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:10.067+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:10.807 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:10.806+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:11.083 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:11.082+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:11.807 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:11.806+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:12.040 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:12.039+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:12.836 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:12.834+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:13.029 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:13.028+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:13.827 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:13.826+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:14.067 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:14.066+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:14.809 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:14.808+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:15.081 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:15.080+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:15.805 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:15.804+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:16.098 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:16.097+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:16.771 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:16.770+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:17.069 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:17.068+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:17.815 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:17.813+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:18.067 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:18.066+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:18.779 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:18.778+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:19.027 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:19.026+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:19.829 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:19.828+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:20.048 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:20.046+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:20.786 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:20.785+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:21.039 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:21.038+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:21.757 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:21.756+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:22.066 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:22.063+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:22.792 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:22.790+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:23.084 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:23.083+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:23.745 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:23.744+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:24.081 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:24.080+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:24.747 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:24.746+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:25.102 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:25.101+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:25.792 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:25.791+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:26.055 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:26.054+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:26.764 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:26.763+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:27.047 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:27.045+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:27.767 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:27.766+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:28.045 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:28.044+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:28.739 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:28.737+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:29.074 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:29.073+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:29.756 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:29.752+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:30.053 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:30.051+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:30.723 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:30.722+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:31.069 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:31.068+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:31.761 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:31.760+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:32.058 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:32.057+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:32.807 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:32.806+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:33.068 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:33.067+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:33.779 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:33.778+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:34.088 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:34.087+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:34.752 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:34.751+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:35.088 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:35.086+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:35.802 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:35.801+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:36.067 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:36.066+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:36.845 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:36.844+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:37.094 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:37.093+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:37.796 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:37.795+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:38.065 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:38.064+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:38.777 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:38.775+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:39.065 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:39.064+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:39.787 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:39.786+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:40.110 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:40.109+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:40.809 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:40.808+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:41.161 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:41.160+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:41.829 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:41.828+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:42.142 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:42.141+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:42.842 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:42.841+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:43.126 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:43.125+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:43.801 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:43.799+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:44.153 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:44.151+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:44.773 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:44.771+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:45.132 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:45.130+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:45.732 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:45.730+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:46.160 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:46.158+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:46.758 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:46.756+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:47.200 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:47.198+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:47.773 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:47.771+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:48.206 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:48.204+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:48.785 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:48.783+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:49.162 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:49.160+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:49.768 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:49.766+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:50.129 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:50.127+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:50.755 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:50.753+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:51.125 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:51.123+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:51.780 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:51.778+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:52.170 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:52.168+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:52.747 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:52.746+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:53.203 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:53.202+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:53.759 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:53.758+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:54.227 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:54.226+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:54.808 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:54.807+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:55.198 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:55.197+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:55.781 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:55.780+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:56.175 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:56.174+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:56.799 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:56.798+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:57.191 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:57.190+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:57.801 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:57.800+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:58.181 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:58.180+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:58.834 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:58.832+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:36:59.195 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:36:59.194+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:36:59.838 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:36:59.837+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:00.205 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:00.204+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:00.807 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:00.806+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:01.236 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:01.235+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:01.783 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:01.782+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:02.263 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:02.262+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:02.783 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:02.781+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:03.271 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:03.270+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:03.821 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:03.820+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:04.307 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:04.306+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:04.847 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:04.846+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:05.345 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:05.344+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:05.837 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:05.836+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:06.305 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:06.304+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:06.860 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:06.859+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:07.289 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:07.288+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:07.865 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:07.864+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:08.251 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:08.250+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:08.880 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:08.879+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:09.215 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:09.213+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:09.843 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:09.842+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:10.255 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:10.254+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:10.836 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:10.835+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:11.255 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:11.254+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:11.877 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:11.876+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:12.293 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:12.291+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:12.840 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:12.839+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:13.293 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:13.292+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:13.808 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:13.806+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:14.294 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:14.292+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:14.802 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:14.801+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:15.308 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:15.307+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:15.832 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:15.830+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:16.312 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:16.310+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:16.825 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:16.823+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:17.328 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:17.327+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:17.837 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:17.836+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:18.314 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:18.312+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:18.825 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:18.824+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:19.267 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:19.266+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:19.822 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:19.821+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:20.298 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:20.297+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:20.789 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:20.788+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:21.275 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:21.274+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:21.751 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:21.750+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:22.293 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:22.292+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:22.760 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:22.759+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:23.304 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:23.303+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:23.723 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:23.722+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:24.295 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:24.294+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:24.745 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:24.744+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:25.273 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:25.272+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:25.748 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:25.746+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:26.240 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:26.238+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:26.733 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:26.731+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:27.242 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:27.240+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:27.748 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:27.746+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:28.287 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:28.285+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:28.779 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:28.777+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:29.336 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:29.333+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:29.820 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:29.818+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:30.365 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:30.363+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:30.838 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:30.836+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:31.357 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:31.355+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:31.842 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:31.838+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:32.395 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:32.393+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:32.849 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:32.847+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:33.394 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:33.392+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:33.860 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:33.858+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:34.360 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:34.357+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:34.852 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:34.850+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:35.410 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:35.408+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:35.844 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:35.843+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:36.399 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:36.398+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:36.833 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:36.832+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:37.403 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:37.402+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:37.796 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:37.794+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:38.412 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:38.411+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:38.837 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:38.836+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:39.425 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:39.424+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:39.874 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:39.873+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:40.409 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:40.408+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:40.881 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:40.880+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:41.452 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:41.451+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:41.889 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:41.888+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:42.428 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:42.427+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:42.866 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:42.864+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:43.411 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:43.410+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:43.881 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:43.880+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:44.446 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:44.444+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:44.931 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:44.930+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:45.448 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:45.447+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:45.912 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:45.910+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:46.412 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:46.411+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:46.920 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:46.919+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:47.364 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:47.363+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:47.903 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:47.902+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:48.370 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:48.368+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:48.890 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:48.889+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:49.412 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:49.410+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:49.879 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:49.877+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:50.380 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:50.378+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:50.920 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:50.919+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:51.386 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:51.385+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:51.900 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:51.899+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:52.420 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:52.419+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:52.885 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:52.884+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:53.458 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:53.457+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:53.915 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:53.914+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:54.462 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:54.410+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:54.965 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:54.964+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:55.460 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:55.459+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:55.930 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:55.927+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:56.463 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:56.461+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:56.908 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:56.907+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:57.490 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:57.489+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:57.933 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:57.931+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:58.496 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:58.495+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:58.948 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:58.947+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:37:59.510 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:37:59.509+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:37:59.931 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:37:59.929+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:00.556 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:00.555+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:00.918 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:00.917+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:01.547 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:01.546+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:01.956 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:01.954+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:02.545 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:02.544+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:02.995 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:02.993+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:03.542 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:03.541+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:03.996 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:03.994+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:04.543 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:04.541+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:04.957 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:04.955+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:05.553 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:05.552+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:05.964 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:05.963+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:06.598 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:06.597+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:06.980 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:06.979+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:07.600 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:07.598+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:07.960 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:07.959+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:08.589 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:08.588+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:08.956 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:08.954+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:09.604 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:09.602+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:09.910 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:09.908+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:10.570 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:10.568+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:10.864 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:10.862+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:11.590 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:11.588+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:11.834 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:11.832+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:12.614 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:12.612+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:12.848 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:12.846+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:13.630 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:13.628+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:13.823 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:13.821+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:14.662 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:14.660+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:14.786 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:14.784+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:15.657 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:15.652+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:15.787 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:15.785+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:16.629 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:16.627+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:16.822 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:16.820+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:17.672 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:17.670+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:17.843 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:17.841+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:18.629 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:18.628+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:18.881 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:18.880+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:19.663 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:19.661+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:19.836 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:19.835+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:20.709 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:20.707+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:20.887 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:20.885+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:21.686 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:21.684+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:21.900 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:21.899+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:22.697 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:22.696+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:22.879 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:22.878+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:23.729 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:23.728+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:23.888 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:23.886+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:24.683 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:24.682+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:24.895 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:24.893+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:25.731 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:25.730+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:25.935 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:25.934+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:26.767 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:26.766+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:26.913 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:26.912+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:27.737 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:27.733+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:27.957 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:27.956+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:28.732 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:28.730+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:28.993 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:28.991+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:29.775 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:29.774+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:29.946 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:29.945+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:30.826 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:30.824+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:30.900 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:30.898+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:31.789 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:31.787+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:31.921 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:31.920+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:32.759 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:32.757+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:32.878 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:32.877+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:33.804 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:33.803+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:33.855 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:33.853+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:34.795 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:34.793+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:34.883 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:34.882+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:35.753 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:35.751+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:35.913 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:35.912+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:36.784 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:36.782+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:36.917 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:36.916+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:37.789 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:37.787+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:37.876 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:37.874+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:38.756 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:38.755+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:38.865 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:38.864+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:39.736 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:39.735+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:39.907 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:39.905+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:40.786 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:40.784+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:40.907 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:40.906+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:41.831 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:41.829+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:41.862 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:41.860+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:42.843 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:42.842+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:42.847 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:42.845+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:43.865 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:43.864+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:43.893 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:43.891+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:44.861 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:44.859+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:44.897 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:44.896+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:45.881 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:45.880+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:45.906 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:45.904+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:46.858 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:46.857+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:46.937 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:46.936+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:47.831 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:47.829+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:47.906 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:47.905+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:48.817 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:48.815+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:48.890 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:48.888+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:49.791 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:49.790+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:49.877 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:49.876+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:50.783 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:50.782+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:50.879 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:50.878+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:51.738 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:51.736+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:51.857 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:51.854+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:52.729 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:52.726+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:52.863 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:52.860+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:53.714 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:53.712+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:53.837 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:53.834+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:54.701 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:54.698+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:54.830 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:54.828+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:55.718 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:55.716+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:55.847 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:55.844+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:56.687 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:56.685+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:56.810 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:56.808+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:57.730 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:57.727+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:57.829 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:57.826+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:58.772 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:58.769+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:58.802 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:58.800+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:38:59.818 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:38:59.815+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:38:59.839 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:38:59.837+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:00.867 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:00.866+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:00.874 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:00.873+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:01.907 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:01.906+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:01.917 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:01.916+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:02.877 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:02.876+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:02.912 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:02.911+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:03.874 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:03.873+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:03.925 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:03.923+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:04.860 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:04.859+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:04.937 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:04.935+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:05.814 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:05.813+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:05.924 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:05.923+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:06.773 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:06.772+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:06.966 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:06.965+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:07.751 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:07.750+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:07.988 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:07.986+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:08.789 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:08.788+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:08.952 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:08.951+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:09.818 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:09.815+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:09.972 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:09.970+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:10.797 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:10.796+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:10.970 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:10.969+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:11.751 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:11.750+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:11.983 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:11.982+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:12.735 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:12.734+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:13.033 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:13.032+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:13.781 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:13.777+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:14.022 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:14.019+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:14.818 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:14.816+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:15.003 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:15.001+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:15.852 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:15.850+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:16.009 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:16.008+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:16.883 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:16.881+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:16.982 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:16.981+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:17.878 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:17.877+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:17.982 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:17.980+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:18.893 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:18.892+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:18.980 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:18.979+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:19.888 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:19.887+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:19.981 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:19.979+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:20.894 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:20.893+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:21.016 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:21.014+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:21.930 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:21.928+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:21.967 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:21.966+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:22.967 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:22.965+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:23.018 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:23.016+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:23.973 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:23.970+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:24.010 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:24.009+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:24.988 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:24.987+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:25.036 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:25.035+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:25.991 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:25.990+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:26.064 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:26.063+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:27.034 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:27.033+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:27.092 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:27.090+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:28.069 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:28.068+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:28.092 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:28.090+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:29.078 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:29.077+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:29.118 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:29.117+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:30.129 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:30.127+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:30.165 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:30.164+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:31.148 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:31.146+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:31.156 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:31.155+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:32.112 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:32.111+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:32.193 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:32.191+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:33.146 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:33.144+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:33.243 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:33.242+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:34.129 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:34.127+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:34.233 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:34.231+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:35.084 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:35.082+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:35.273 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:35.271+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:36.090 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:36.088+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:36.226 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:36.223+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:37.083 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:37.081+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:37.215 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:37.212+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:38.110 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:38.108+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:38.246 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:38.244+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:39.110 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:39.108+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:39.216 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:39.214+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:40.134 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:40.131+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:40.183 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:40.180+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:41.130 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:41.127+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:41.141 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:41.139+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:42.129 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:42.127+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:42.168 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:42.166+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:43.093 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:43.090+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:43.126 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:43.123+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:44.087 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:44.085+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:44.115 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:44.114+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:45.101 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:45.100+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:45.102 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:45.100+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:46.073 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:46.072+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:46.131 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:46.130+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:47.060 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:47.058+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:47.110 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:47.108+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:48.081 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:48.080+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:48.093 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:48.092+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:49.063 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:49.062+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:49.097 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:49.095+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:50.069 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:50.068+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:50.079 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:50.077+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:51.107 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:51.106+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:51.112 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:51.111+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:52.097 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:52.096+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:52.116 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:52.115+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:53.129 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:53.127+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:53.165 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:53.163+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:54.112 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:54.111+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:54.201 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:54.200+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:55.151 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:55.149+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:55.250 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:55.248+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:56.135 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:56.134+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:56.207 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:56.205+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:57.089 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:57.087+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:57.255 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:57.254+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:58.093 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:58.092+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:58.219 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:58.217+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:39:59.057 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:39:59.056+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:39:59.209 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:39:59.208+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:00.105 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:00.104+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:00.219 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:00.218+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:01.113 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:01.111+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:01.193 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:01.192+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:02.117 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:02.115+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:02.189 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:02.188+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:03.138 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:03.136+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:03.205 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:03.204+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:04.092 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:04.091+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:04.191 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:04.190+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:05.087 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:05.086+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:05.177 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:05.176+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:06.091 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:06.090+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:06.177 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:06.175+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:07.056 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:07.054+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:07.130 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:07.128+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:08.100 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:08.098+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:08.128 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:08.126+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:09.109 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:09.108+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:09.149 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:09.148+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:10.118 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:10.116+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:10.176 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:10.174+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:11.131 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:11.130+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:11.166 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:11.164+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:12.101 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:12.099+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:12.179 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:12.177+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:13.087 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:13.086+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:13.205 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:13.203+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:14.039 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:14.037+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:14.245 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:14.244+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:15.035 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:15.033+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:15.277 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:15.275+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:16.054 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:16.052+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:16.227 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:16.226+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:17.073 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:17.071+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:17.254 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:17.252+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:18.083 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:18.081+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:18.266 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:18.264+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:19.093 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:19.091+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:19.233 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:19.231+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:20.063 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:20.061+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:20.226 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:20.224+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:21.060 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:21.058+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:21.207 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:21.205+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:22.077 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:22.074+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:22.204 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:22.201+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:23.125 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:23.123+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:23.190 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:23.187+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:24.088 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:24.085+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:24.174 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:24.171+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:25.073 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:25.071+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:25.207 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:25.204+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:26.119 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:26.117+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:26.249 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:26.247+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:27.148 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:27.147+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:27.218 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:27.217+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:28.191 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:28.189+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:28.258 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:28.257+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:29.167 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:29.166+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:29.235 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:29.233+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:30.157 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:30.156+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:30.222 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:30.220+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:31.114 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:31.113+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:31.238 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:31.237+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:32.133 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:32.131+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:32.196 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:32.195+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:33.132 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:33.131+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:33.210 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:33.209+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:34.098 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:34.097+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:34.205 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:34.204+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:35.118 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:35.117+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:35.179 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:35.178+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:36.161 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:36.160+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:36.168 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:36.167+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:37.122 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:37.121+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:37.215 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:37.213+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:38.102 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:38.101+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:38.214 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:38.213+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:39.104 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:39.102+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:39.193 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:39.192+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:40.074 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:40.072+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:40.163 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:40.161+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:41.069 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:41.067+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:41.118 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:41.117+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:42.112 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:42.111+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:42.124 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:42.122+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:43.125 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:43.123+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:43.132 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:43.131+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:44.120 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:44.118+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:44.131 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:44.130+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:45.156 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:45.155+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:45.178 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:45.177+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:46.120 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:46.119+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:46.166 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:46.165+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:47.170 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:47.168+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:47.191 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:47.190+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:48.197 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:48.196+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:48.238 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:48.237+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:49.206 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:49.205+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:49.239 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:49.237+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:50.207 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:50.206+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:50.235 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:50.234+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:51.162 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:51.160+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:51.242 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:51.240+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:52.196 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:52.194+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:52.201 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:52.200+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:53.163 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:53.162+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:53.179 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:53.177+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:54.142 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:54.141+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:54.205 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:54.203+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:55.180 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:55.179+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:55.202 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:55.200+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:56.132 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:56.131+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:56.202 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:56.201+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:57.138 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:57.137+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:57.198 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:57.196+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:58.161 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:58.159+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:58.240 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:58.239+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:40:59.119 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:40:59.117+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:40:59.276 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:40:59.275+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:00.161 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:00.158+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:00.300 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:00.298+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:01.196 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:01.194+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:01.283 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:01.280+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:02.165 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:02.162+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:02.325 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:02.322+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:03.163 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:03.160+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:03.281 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:03.279+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:04.119 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:04.117+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:04.234 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:04.231+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:05.156 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:05.153+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:05.248 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:05.246+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:06.156 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:06.153+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:06.284 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:06.281+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:07.202 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:07.199+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:07.275 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:07.273+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:08.243 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:08.241+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:08.317 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:08.316+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:09.262 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:09.261+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:09.285 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:09.283+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:10.265 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:10.263+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:10.275 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:10.273+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:11.269 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:11.267+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:11.310 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:11.309+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:12.262 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:12.261+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:12.309 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:12.308+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:13.278 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:13.277+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:13.352 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:13.351+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:14.236 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:14.234+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:14.372 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:14.370+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:15.276 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:15.274+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:15.394 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:15.392+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:16.305 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:16.304+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:16.412 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:16.411+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:17.329 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:17.328+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:17.393 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:17.392+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:18.355 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:18.353+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:18.419 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:18.417+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:19.377 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:19.373+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:19.404 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:19.403+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:20.355 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:20.354+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:20.405 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:20.404+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:21.345 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:21.344+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:21.399 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:21.397+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:22.353 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:22.351+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:22.358 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:22.357+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:23.315 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:23.314+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:23.349 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:23.348+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:24.363 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:24.361+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:24.378 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:24.377+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:25.391 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:25.389+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:25.426 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:25.424+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:26.352 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:26.351+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:26.377 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:26.375+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:27.358 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:27.357+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:27.361 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:27.360+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:28.393 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:28.392+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:28.394 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:28.392+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:29.367 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:29.366+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:29.422 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:29.421+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:30.326 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:30.325+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:30.460 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:30.459+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:31.340 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:31.339+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:31.424 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:31.423+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:32.319 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:32.317+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:32.381 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:32.380+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:33.300 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:33.299+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:33.353 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:33.352+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:34.296 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:34.294+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:34.347 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:34.345+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:35.310 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:35.309+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:35.323 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:35.322+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:36.282 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:36.280+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:36.324 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:36.322+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:37.246 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:37.245+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:37.316 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:37.315+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:38.232 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:38.231+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:38.292 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:38.290+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:39.256 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:39.254+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:39.268 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:39.266+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:40.226 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:40.225+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:40.254 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:40.253+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:41.180 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:41.179+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:41.279 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:41.277+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:42.134 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:42.132+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:42.252 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:42.250+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:43.096 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:43.094+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:43.225 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:43.222+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:44.062 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:44.060+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:44.265 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:44.262+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:45.050 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:45.048+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:45.298 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:45.296+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:46.029 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:46.026+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:46.349 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:46.346+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:47.046 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:47.044+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:47.335 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:47.332+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:48.028 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:48.025+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:48.296 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:48.294+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:49.012 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:49.010+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:49.322 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:49.320+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:49.965 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:49.963+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:50.352 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:50.350+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:50.927 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:50.924+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:51.370 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:51.369+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:51.890 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:51.889+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:52.370 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:52.368+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:52.883 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:52.882+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:53.350 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:53.349+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:53.845 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:53.843+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:54.350 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:54.349+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:54.854 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:54.853+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:55.321 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:55.320+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:55.865 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:55.863+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:56.359 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:56.358+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:56.893 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:56.891+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:57.352 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:57.351+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:57.864 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:57.863+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:58.401 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:58.400+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:58.862 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:58.860+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:41:59.410 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:41:59.409+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:41:59.865 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:41:59.863+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:00.448 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:00.446+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:00.906 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:00.905+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:01.489 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:01.487+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:01.890 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:01.888+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:02.457 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:02.456+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:02.932 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:02.931+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:03.463 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:03.461+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:03.916 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:03.915+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:04.447 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:04.446+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:04.913 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:04.911+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:05.408 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:05.406+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:05.878 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:05.876+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:06.417 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:06.415+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:06.926 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:06.925+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:07.427 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:07.426+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:07.943 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:07.942+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:08.390 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:08.389+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:08.967 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:08.965+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:09.400 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:09.399+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:10.014 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:10.013+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:10.426 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:10.424+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:11.026 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:11.024+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:11.447 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:11.445+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:11.993 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:11.992+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:12.416 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:12.415+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:12.947 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:12.946+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:13.369 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:13.368+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:13.965 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:13.963+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:14.328 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:14.326+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:14.927 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:14.926+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:15.330 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:15.327+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:15.944 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:15.942+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:16.338 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:16.337+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:16.897 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:16.895+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:17.385 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:17.384+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:17.868 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:17.867+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:18.339 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:18.338+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:18.896 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:18.895+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:19.317 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:19.316+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:19.908 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:19.906+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:20.296 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:20.295+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:20.888 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:20.887+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:21.328 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:21.327+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:21.891 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:21.889+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:22.336 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:22.334+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:22.902 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:22.900+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:23.373 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:23.371+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:23.856 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:23.854+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:24.392 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:24.391+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:24.826 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:24.823+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:25.372 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:25.370+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:25.859 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:25.857+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:26.399 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:26.397+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:26.825 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:26.821+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:27.447 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:27.445+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:27.850 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:27.848+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:28.437 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:28.434+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:28.804 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:28.802+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:29.424 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:29.422+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:29.810 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:29.808+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:30.436 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:30.434+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:30.809 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:30.806+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:31.456 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:31.454+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:31.814 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:31.812+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:32.418 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:32.415+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:32.804 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:32.802+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:33.408 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:33.406+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:33.853 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:33.851+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:34.434 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:34.432+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:34.881 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:34.880+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:35.475 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:35.473+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:35.924 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:35.922+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:36.478 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:36.476+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:36.882 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:36.880+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:37.470 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:37.468+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:37.918 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:37.916+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:38.451 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:38.449+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:38.872 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:38.871+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:39.443 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:39.442+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:39.855 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:39.853+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:40.431 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:40.430+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:40.896 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:40.894+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:41.412 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:41.410+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:41.868 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:41.866+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:42.380 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:42.378+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:42.848 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:42.845+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:43.349 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:43.348+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:43.826 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:43.823+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:44.343 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:44.341+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:44.872 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:44.870+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:45.311 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:45.309+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:45.823 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:45.822+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:46.267 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:46.266+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:46.870 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:46.868+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:47.289 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:47.287+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:47.864 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:47.863+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:48.322 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:48.321+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:48.829 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:48.828+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:49.333 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:49.331+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:49.832 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:49.830+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:50.310 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:50.307+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:50.851 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:50.850+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:51.266 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:51.264+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:51.827 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:51.825+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:52.268 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:52.266+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:52.857 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:52.856+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:53.244 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:53.242+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:53.862 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:53.860+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:54.206 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:54.205+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:54.878 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:54.876+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:55.231 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:55.230+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:55.862 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:55.861+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:56.281 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:56.280+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:56.846 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:56.844+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:57.250 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:57.248+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:57.893 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:57.891+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:58.244 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:58.243+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:58.915 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:58.913+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:42:59.204 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:42:59.202+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:42:59.886 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:42:59.884+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:00.205 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:00.204+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:00.843 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:00.841+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:01.225 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:01.224+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:01.817 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:01.815+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:02.196 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:02.194+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:02.787 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:02.786+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:03.151 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:03.150+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:03.823 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:03.822+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:04.188 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:04.186+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:04.827 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:04.825+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:05.195 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:05.194+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:05.847 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:05.845+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:06.225 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:06.223+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:06.881 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:06.880+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:07.184 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:07.181+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:07.844 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:07.842+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:08.197 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:08.195+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:08.889 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:08.886+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:09.225 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:09.222+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:09.903 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:09.901+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:10.268 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:10.265+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:10.863 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:10.860+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:11.279 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:11.276+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:11.842 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:11.839+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:12.319 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:12.316+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:12.857 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:12.854+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:13.324 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:13.322+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:13.898 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:13.895+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:14.365 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:14.362+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:14.909 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:14.906+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:15.397 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:15.395+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:15.860 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:15.858+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:16.403 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:16.402+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:16.874 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:16.872+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:17.424 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:17.422+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:17.901 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:17.900+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:18.440 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:18.439+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:18.944 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:18.942+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:19.483 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:19.482+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:19.982 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:19.980+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:20.524 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:20.522+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:20.969 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:20.968+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:21.493 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:21.492+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:21.992 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:21.990+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:22.522 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:22.520+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:22.964 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:22.963+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:23.497 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:23.495+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:23.945 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:23.943+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:24.499 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:24.497+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:24.921 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:24.920+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:25.454 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:25.452+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:25.938 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:25.936+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:26.456 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:26.454+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:26.895 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:26.893+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:27.419 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:27.417+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:27.864 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:27.862+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:28.428 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:28.394+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:28.844 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:28.842+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:29.427 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:29.425+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:29.876 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:29.874+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:30.385 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:30.384+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:30.873 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:30.872+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:31.382 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:31.380+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:31.888 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:31.886+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:32.368 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:32.367+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:32.880 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:32.878+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:33.343 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:33.342+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:33.833 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:33.830+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:34.315 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:34.313+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:34.845 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:34.844+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:35.285 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:35.283+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:35.854 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:35.852+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:36.248 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:36.246+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:36.852 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:36.851+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:37.287 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:37.286+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:37.817 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:37.816+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:38.238 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:38.236+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:38.777 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:38.775+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:39.190 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:39.188+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:39.813 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:39.811+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:40.233 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:40.231+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:40.805 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:40.804+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:41.254 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:41.252+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:41.777 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:41.776+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:42.276 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:42.274+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:42.742 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:42.740+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:43.267 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:43.265+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:43.693 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:43.691+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:44.236 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:44.234+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:44.679 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:44.677+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:45.275 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:45.274+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:45.725 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:45.724+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:46.289 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:46.288+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:46.764 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:46.762+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:47.340 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:47.338+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:47.785 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:47.784+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:48.389 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:48.388+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:48.808 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:48.806+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:49.360 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:49.358+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:49.830 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:49.827+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:50.373 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:50.370+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:50.828 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:50.825+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:51.367 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:51.365+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:51.858 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:51.855+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:52.379 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:52.376+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:52.854 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:52.851+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:53.356 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:53.353+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:53.851 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:53.848+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:54.402 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:54.399+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:54.893 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:54.890+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:55.383 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:55.381+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:55.882 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:55.879+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:56.377 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:56.373+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:56.907 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:56.904+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:57.348 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:57.346+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:57.922 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:57.920+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:58.342 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:58.340+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:58.889 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:58.887+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:43:59.387 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:43:59.384+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:43:59.891 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:43:59.889+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:00.419 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:00.417+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:00.920 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:00.918+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:01.383 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:01.381+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:01.898 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:01.895+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:02.363 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:02.361+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:02.946 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:02.945+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:03.350 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:03.348+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:03.951 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:03.949+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:04.310 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:04.309+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:04.989 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:04.987+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:05.316 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:05.315+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:06.023 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:06.021+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:06.271 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:06.269+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:07.054 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:07.053+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:07.309 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:07.307+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:08.100 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:08.099+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:08.316 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:08.314+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:09.081 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:09.079+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:09.351 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:09.349+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:10.057 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:10.055+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:10.370 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:10.368+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:11.094 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:11.093+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:11.361 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:11.359+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:12.076 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:12.074+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:12.404 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:12.402+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:13.102 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:13.101+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:13.387 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:13.385+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:14.136 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:14.135+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:14.342 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:14.341+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:15.128 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:15.126+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:15.390 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:15.388+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:16.084 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:16.083+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:16.412 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:16.410+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:17.092 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:17.090+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:17.404 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:17.403+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:18.097 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:18.095+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:18.362 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:18.360+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:19.059 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:19.057+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:19.411 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:19.409+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:20.059 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:20.057+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:20.432 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:20.428+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:21.668 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:21.084+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:21.669 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:21.385+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:22.128 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:22.126+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:22.365 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:22.363+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:23.114 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:23.112+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:23.374 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:23.372+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:24.069 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:24.068+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:24.326 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:24.324+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:25.078 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:25.076+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:25.302 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:25.301+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:26.059 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:26.057+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:26.273 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:26.271+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:27.028 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:27.026+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:27.292 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:27.291+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:28.042 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:28.041+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:28.307 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:28.305+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:29.076 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:29.074+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:29.263 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:29.261+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:30.117 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:30.115+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:30.273 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:30.271+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:31.130 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:31.129+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:31.244 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:31.242+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:32.142 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:32.140+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:32.212 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:32.210+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:33.161 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:33.159+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:33.171 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:33.168+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:34.143 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:34.140+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:34.162 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:34.159+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:35.116 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:35.113+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:35.187 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:35.184+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:36.103 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:36.100+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:36.183 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:36.180+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:37.098 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:37.095+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:37.149 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:37.146+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:38.064 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:38.061+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:38.140 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:38.137+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:39.102 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:39.099+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:39.104 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:39.102+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:40.147 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:40.145+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:40.154 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:40.151+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:41.104 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:41.101+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:41.117 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:41.114+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:42.131 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:42.129+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:42.157 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:42.155+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:43.140 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:43.139+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:43.181 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:43.179+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:44.113 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:44.110+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:44.170 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:44.168+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:45.136 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:45.135+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:45.147 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:45.145+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:46.125 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:46.123+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:46.161 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:46.159+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:47.132 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:47.131+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:47.155 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:47.153+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:48.089 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:48.087+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:48.154 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:48.152+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:49.104 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:49.102+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:49.136 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:49.134+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:50.069 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:50.067+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:50.166 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:50.165+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:51.107 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:51.105+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:51.187 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:51.185+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:52.119 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:52.117+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:52.196 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:52.194+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:53.143 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:53.141+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:53.228 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:53.226+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:54.148 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:54.145+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:54.217 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:54.215+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:55.115 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:55.113+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:55.227 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:55.225+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:56.137 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:56.136+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:56.262 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:56.261+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:57.098 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:57.097+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:57.272 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:57.270+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:58.137 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:58.135+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:58.224 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:58.223+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:44:59.093 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:44:59.091+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:44:59.217 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:44:59.215+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:00.095 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:00.093+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:00.264 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:00.262+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:01.087 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:01.085+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:01.262 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:01.260+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:02.098 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:02.097+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:02.252 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:02.250+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:03.070 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:03.068+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:03.258 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:03.256+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:04.042 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:04.041+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:04.285 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:04.283+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:05.044 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:05.042+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:05.247 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:05.245+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:06.040 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:06.039+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:06.281 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:06.279+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:07.050 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:07.046+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:07.299 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:07.298+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:08.010 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:08.008+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:08.331 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:08.329+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:09.003 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:09.001+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:09.313 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:09.311+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:09.962 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:09.960+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:10.288 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:10.286+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:10.992 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:10.991+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:11.249 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:11.247+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:11.987 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:11.985+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:12.290 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:12.288+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:12.971 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:12.969+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:13.303 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:13.301+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:13.945 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:13.943+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:14.309 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:14.307+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:14.938 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:14.936+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:15.325 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:15.322+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:15.922 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:15.919+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:16.324 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:16.322+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:16.908 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:16.906+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:17.371 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:17.368+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:17.933 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:17.930+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:18.413 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:18.410+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:18.958 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:18.956+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:19.462 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:19.460+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:19.921 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:19.918+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:20.435 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:20.432+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:20.945 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:20.943+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:21.400 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:21.397+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:21.932 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:21.929+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:22.376 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:22.373+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:22.926 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:22.922+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:23.359 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:23.356+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:23.924 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:23.922+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:24.314 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:24.313+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:24.888 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:24.886+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:25.294 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:25.291+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:25.916 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:25.915+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:26.245 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:26.243+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:26.940 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:26.938+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:27.232 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:27.230+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:27.930 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:27.929+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:28.198 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:28.197+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:28.942 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:28.941+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:29.245 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:29.243+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:29.965 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:29.964+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:30.255 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:30.253+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:30.918 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:30.916+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:31.285 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:31.283+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:31.911 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:31.909+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:32.286 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:32.284+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:32.891 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:32.889+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:33.265 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:33.263+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:33.876 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:33.874+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:34.245 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:34.243+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:34.890 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:34.888+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:35.237 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:35.235+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:35.941 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:35.939+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:36.284 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:36.282+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:36.906 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:36.905+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:37.253 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:37.252+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:37.919 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:37.917+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:38.245 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:38.243+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:38.959 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:38.957+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:39.251 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:39.249+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:39.950 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:39.948+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:40.264 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:40.262+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:40.993 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:40.991+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:41.292 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:41.291+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:42.040 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:42.038+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:42.256 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:42.255+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:43.062 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:43.061+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:43.212 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:43.211+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:44.090 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:44.088+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:44.184 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:44.182+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:45.139 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:45.138+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:45.163 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:45.161+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:46.152 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:46.150+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:46.174 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:46.172+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:47.110 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:47.108+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:47.178 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:47.176+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:48.069 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:48.068+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:48.168 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:48.167+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:49.025 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:49.023+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:49.130 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:49.128+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:50.062 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:50.060+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:50.124 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:50.123+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:51.072 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:51.070+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:51.144 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:51.142+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:52.028 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:52.026+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:52.142 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:52.141+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:53.073 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:53.071+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:53.137 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:53.135+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:54.081 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:54.079+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:54.093 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:54.091+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:55.050 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:55.047+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:55.093 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:55.092+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:56.094 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:56.093+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:56.097 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:56.095+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:57.090 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:57.088+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:57.101 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:57.099+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:58.079 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:58.077+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:58.113 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:58.111+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:59.036 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:59.033+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:45:59.100 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:45:59.097+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:45:59.988 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:45:59.985+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:00.132 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:00.129+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:01.038 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:01.035+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:01.139 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:01.136+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:02.045 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:02.043+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:02.169 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:02.166+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:03.013 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:03.010+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:03.211 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:03.208+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:04.032 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:04.029+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:04.219 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:04.215+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:04.991 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:04.988+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:05.215 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:05.212+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:06.038 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:06.035+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:06.173 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:06.170+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:07.020 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:07.017+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:07.125 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:07.122+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:08.017 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:08.015+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:08.150 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:08.148+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:09.037 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:09.036+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:09.152 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:09.150+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:10.067 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:10.066+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:10.120 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:10.118+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:11.067 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:11.065+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:11.148 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:11.146+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:12.106 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:12.104+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:12.182 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:12.180+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:13.091 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:13.089+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:13.208 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:13.206+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:14.126 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:14.124+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:14.161 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:14.159+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:15.162 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:15.159+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:15.188 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:15.186+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:16.147 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:16.146+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:16.194 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:16.190+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:17.161 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:17.159+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:17.202 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:17.201+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:18.202 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:18.200+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:18.222 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:18.220+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:19.177 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:19.175+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:19.224 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:19.222+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:20.168 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:20.166+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:20.236 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:20.234+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:21.156 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:21.154+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:21.257 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:21.255+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:22.143 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:22.142+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:22.274 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:22.272+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:23.119 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:23.117+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:23.310 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:23.307+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:24.134 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:24.132+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:24.324 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:24.323+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:25.160 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:25.158+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:25.354 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:25.352+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:26.193 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:26.192+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:26.351 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:26.349+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:27.216 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:27.214+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:27.394 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:27.392+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:28.194 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:28.192+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:28.414 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:28.412+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:29.146 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:29.144+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:29.400 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:29.398+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:30.156 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:30.154+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:30.388 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:30.386+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:31.205 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:31.203+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:31.407 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:31.405+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:32.201 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:32.199+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:32.457 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:32.455+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:33.205 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:33.203+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:33.440 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:33.438+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:34.253 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:34.251+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:34.432 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:34.430+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:35.228 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:35.225+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:35.443 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:35.441+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:36.237 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:36.235+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:36.412 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:36.411+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:37.255 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:37.253+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:37.410 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:37.408+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:38.260 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:38.258+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:38.387 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:38.386+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:39.216 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:39.214+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:39.426 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:39.424+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:40.185 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:40.183+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:40.461 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:40.459+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:41.168 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:41.166+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:41.421 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:41.419+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:42.161 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:42.158+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:42.441 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:42.438+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:43.167 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:43.164+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:43.450 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:43.447+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:44.137 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:44.134+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:44.428 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:44.425+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:45.152 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:45.149+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:45.383 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:45.381+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:46.197 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:46.194+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:46.396 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:46.393+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:47.186 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:47.183+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:47.350 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:47.347+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:48.147 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:48.144+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:48.334 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:48.332+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:49.174 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:49.171+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:49.366 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:49.363+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:50.200 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:50.197+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:50.411 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:50.409+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:51.195 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:51.193+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:51.363 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:51.361+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:52.236 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:52.234+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:52.338 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:52.335+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:53.219 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:53.217+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:53.373 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:53.371+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:54.264 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:54.262+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:54.386 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:54.383+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:55.301 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:55.299+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:55.376 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:55.375+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:56.303 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:56.301+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:56.366 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:56.364+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:57.265 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:57.263+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:57.374 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:57.372+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:58.249 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:58.247+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:58.403 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:58.402+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:46:59.211 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:46:59.209+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:46:59.386 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:46:59.384+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:00.162 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:00.160+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:00.434 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:00.432+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:01.190 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:01.188+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:01.390 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:01.388+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:02.226 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:02.224+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:02.345 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:02.344+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:03.239 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:03.237+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:03.326 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:03.324+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:04.218 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:04.216+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:04.351 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:04.349+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:05.219 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:05.216+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:05.342 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:05.340+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:06.261 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:06.255+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:06.343 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:06.341+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:07.246 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:07.244+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:07.321 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:07.320+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:08.202 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:08.200+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:08.345 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:08.344+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:09.217 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:09.216+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:09.380 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:09.378+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:10.233 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:10.232+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:10.417 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:10.416+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:11.280 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:11.278+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:11.423 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:11.421+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:12.300 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:12.298+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:12.440 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:12.438+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:13.322 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:13.320+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:13.413 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:13.411+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:14.329 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:14.327+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:14.366 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:14.365+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:15.321 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:15.319+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:15.379 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:15.377+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:16.281 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:16.280+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:16.377 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:16.376+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:17.297 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:17.296+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:17.379 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:17.378+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:18.254 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:18.252+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:18.361 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:18.359+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:19.235 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:19.234+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:19.400 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:19.398+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:20.226 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:20.224+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:20.380 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:20.378+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:21.255 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:21.253+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:21.421 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:21.419+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:22.225 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:22.223+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:22.414 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:22.412+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:23.209 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:23.208+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:23.376 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:23.374+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:24.166 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:24.163+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:24.374 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:24.372+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:25.189 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:25.187+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:25.344 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:25.341+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:26.157 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:26.154+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:26.390 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:26.387+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:27.201 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:27.198+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:27.369 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:27.366+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:28.215 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:28.212+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:28.419 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:28.417+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:29.189 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:29.186+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:29.464 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:29.461+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:30.163 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:30.160+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:30.495 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:30.493+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:31.178 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:31.175+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:31.517 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:31.514+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:32.217 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:32.214+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:32.519 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:32.516+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:33.266 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:33.263+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:33.500 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:33.497+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:34.303 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:34.301+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:34.538 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:34.536+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:35.292 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:35.290+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:35.542 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:35.541+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:36.324 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:36.323+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:36.495 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:36.493+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:37.304 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:37.303+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:37.486 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:37.484+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:38.281 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:38.279+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:38.537 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:38.535+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:39.292 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:39.290+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:39.496 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:39.494+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:40.280 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:40.278+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:40.512 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:40.510+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:41.308 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:41.307+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:41.494 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:41.492+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:42.313 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:42.311+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:42.499 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:42.497+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:43.282 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:43.280+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:43.501 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:43.499+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:44.333 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:44.331+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:44.492 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:44.490+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:45.348 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:45.346+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:45.532 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:45.531+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:46.345 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:46.343+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:46.487 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:46.485+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:47.392 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:47.390+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:47.484 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:47.483+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:48.376 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:48.374+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:48.453 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:48.451+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:49.348 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:49.346+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:49.504 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:49.502+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:50.356 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:50.354+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:50.524 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:50.522+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:51.326 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:51.324+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:51.570 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:51.568+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:52.313 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:52.311+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:52.600 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:52.599+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:53.269 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:53.267+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:53.595 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:53.593+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:54.242 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:54.240+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:54.553 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:54.551+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:55.241 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:55.239+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:55.526 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:55.525+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:56.247 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:56.245+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:56.550 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:56.548+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:57.295 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:57.293+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:57.535 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:57.533+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:58.313 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:58.311+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:58.515 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:58.513+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:47:59.264 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:47:59.263+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:47:59.508 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:47:59.506+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:00.255 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:00.253+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:00.489 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:00.487+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:01.228 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:01.227+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:01.519 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:01.517+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:02.220 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:02.218+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:02.474 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:02.472+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:03.173 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:03.171+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:03.436 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:03.434+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:04.207 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:04.205+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:04.391 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:04.389+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:05.194 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:05.193+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:05.429 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:05.427+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:06.216 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:06.215+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:06.453 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:06.450+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:07.216 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:07.215+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:07.426 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:07.424+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:08.238 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:08.235+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:08.475 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:08.473+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:09.264 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:09.262+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:09.516 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:09.513+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:10.269 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:10.266+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:10.536 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:10.533+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:11.278 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:11.275+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:11.500 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:11.498+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:12.328 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:12.325+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:12.472 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:12.469+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:13.371 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:13.368+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:13.486 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:13.483+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:14.401 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:14.398+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:14.519 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:14.516+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:15.383 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:15.380+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:15.473 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:15.470+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:16.388 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:16.385+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:16.426 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:16.424+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:17.418 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:17.415+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:17.425 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:17.422+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:18.404 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:18.402+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:18.407 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:18.405+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:19.414 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:19.413+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:19.431 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:19.429+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:20.387 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:20.385+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:20.435 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:20.433+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:21.365 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:21.363+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:21.419 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:21.417+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:22.350 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:22.348+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:22.395 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:22.393+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:23.362 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:23.360+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:23.396 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:23.394+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:24.403 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:24.401+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:24.435 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:24.433+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:25.389 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:25.387+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:25.430 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:25.428+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:26.354 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:26.352+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:26.398 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:26.397+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:27.336 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:27.334+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:27.438 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:27.436+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:28.305 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:28.303+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:28.485 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:28.483+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:29.350 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:29.349+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:29.504 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:29.502+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:30.361 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:30.359+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:30.483 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:30.481+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:31.379 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:31.377+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:31.514 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:31.513+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:32.351 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:32.349+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:32.505 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:32.503+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:33.402 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:33.400+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:33.459 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:33.457+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:34.376 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:34.374+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:34.444 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:34.442+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:35.396 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:35.394+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:35.401 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:35.400+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:36.359 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:36.357+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:36.401 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:36.399+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:37.389 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:37.387+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:37.401 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:37.399+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:38.397 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:38.394+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:38.421 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:38.419+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:39.358 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:39.356+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:39.387 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:39.385+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:40.330 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:40.328+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:40.434 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:40.432+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:41.307 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:41.305+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:41.428 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:41.426+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:42.327 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:42.325+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:42.463 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:42.461+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:43.307 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:43.305+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:43.434 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:43.432+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:44.336 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:44.334+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:44.433 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:44.429+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:45.345 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:45.343+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:45.405 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:45.403+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:46.319 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:46.317+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:46.434 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:46.433+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:47.317 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:47.315+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:47.447 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:47.445+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:48.330 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:48.329+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:48.431 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:48.429+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:49.328 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:49.326+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:49.424 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:49.423+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:50.353 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:50.351+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:50.475 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:50.473+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:51.355 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:51.353+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:51.450 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:51.447+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:52.331 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:52.328+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:52.409 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:52.406+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:53.363 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:53.360+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:53.389 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:53.386+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:54.345 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:54.342+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:54.379 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:54.377+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:55.370 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:55.368+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:55.380 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:55.378+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:56.342 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:56.340+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:56.365 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:56.362+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:57.295 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:57.292+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:57.409 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:57.406+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:58.306 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:58.303+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:58.452 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:58.449+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:48:59.282 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:48:59.280+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:48:59.422 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:48:59.419+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:00.302 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:00.299+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:00.442 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:00.440+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:01.329 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:01.327+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:01.479 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:01.477+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:02.369 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:02.367+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:02.501 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:02.499+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:03.347 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:03.345+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:03.513 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:03.510+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:04.371 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:04.369+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:04.501 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:04.499+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:05.346 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:05.344+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:05.468 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:05.467+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:06.346 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:06.344+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:06.490 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:06.488+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:07.361 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:07.359+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:07.541 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:07.539+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:08.342 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:08.340+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:08.561 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:08.559+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:09.385 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:09.383+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:09.572 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:09.570+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:10.422 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:10.420+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:10.609 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:10.607+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:11.459 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:11.457+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:11.652 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:11.650+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:12.457 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:12.455+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:12.685 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:12.683+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:13.501 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:13.499+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:13.656 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:13.654+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:14.490 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:14.488+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:14.609 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:14.608+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:15.535 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:15.533+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:15.612 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:15.611+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:16.522 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:16.520+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:16.607 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:16.605+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:17.498 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:17.496+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:17.559 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:17.557+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:18.455 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:18.453+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:18.598 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:18.596+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:19.446 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:19.444+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:19.627 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:19.625+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:20.468 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:20.466+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:20.657 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:20.655+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:21.488 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:21.486+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:21.661 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:21.659+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:22.525 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:22.523+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:22.685 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:22.683+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:23.521 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:23.519+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:23.704 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:23.702+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:24.477 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:24.475+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:24.685 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:24.683+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:25.429 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:25.427+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:25.658 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:25.656+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:26.444 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:26.442+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:26.635 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:26.633+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:27.476 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:27.474+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:27.668 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:27.666+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:28.438 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:28.437+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:28.674 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:28.672+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:29.424 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:29.422+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:29.677 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:29.675+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:30.460 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:30.458+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:30.693 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:30.691+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:31.449 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:31.447+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:31.708 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:31.706+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:32.495 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:32.493+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:32.753 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:32.751+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:33.474 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:33.472+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:33.734 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:33.732+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:34.427 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:34.425+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:34.760 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:34.757+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:35.407 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:35.404+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:35.754 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:35.752+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:36.439 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:36.436+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:36.793 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:36.790+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:37.424 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:37.421+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:37.746 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:37.743+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:38.464 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:38.461+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:38.702 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:38.699+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:39.501 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:39.498+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:39.705 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:39.702+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:40.502 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:40.499+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:40.719 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:40.716+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:41.552 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:41.549+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:41.685 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:41.682+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:42.589 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:42.586+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:42.712 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:42.710+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:43.614 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:43.611+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:43.718 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:43.716+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:44.572 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:44.570+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:44.743 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:44.741+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:45.618 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:45.617+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:45.779 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:45.777+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:46.579 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:46.577+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:46.734 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:46.732+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:47.533 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:47.531+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:47.722 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:47.721+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:48.564 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:48.562+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:48.747 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:48.745+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:49.527 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:49.525+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:49.742 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:49.741+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:50.537 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:50.535+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:50.763 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:50.762+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:51.564 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:51.562+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:51.757 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:51.755+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:52.532 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:52.530+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:52.773 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:52.771+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:53.565 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:53.563+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:53.807 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:53.805+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:54.589 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:54.587+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:54.827 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:54.825+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:55.579 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:55.577+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:55.838 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:55.837+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:56.565 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:56.563+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:56.876 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:56.874+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:57.589 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:57.587+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:57.902 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:57.900+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:58.600 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:58.598+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:58.923 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:58.921+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:49:59.561 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:49:59.559+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:49:59.971 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:49:59.969+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:00.546 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:00.544+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:00.978 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:00.976+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:01.501 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:01.500+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:01.996 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:01.994+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:02.503 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:02.501+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:03.021 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:03.019+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:03.495 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:03.493+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:04.051 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:04.050+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:04.522 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:04.521+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:05.079 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:05.078+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:05.561 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:05.560+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:06.075 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:06.073+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:06.592 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:06.590+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:07.084 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:07.082+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:07.582 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:07.581+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:08.132 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:08.130+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:08.631 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:08.629+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:09.134 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:09.132+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:09.664 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:09.661+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:10.131 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:10.129+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:10.690 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:10.687+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:11.151 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:11.149+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:11.677 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:11.675+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:12.137 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:12.135+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:12.710 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:12.708+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:13.135 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:13.133+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:13.666 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:13.665+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:14.183 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:14.181+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:14.626 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:14.624+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:15.158 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:15.156+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:15.634 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:15.631+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:16.112 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:16.109+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:16.634 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:16.632+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:17.062 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:17.060+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:17.599 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:17.597+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:18.037 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:18.033+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:18.647 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:18.644+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:19.073 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:19.070+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:19.625 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:19.622+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:20.102 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:20.099+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:20.623 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:20.620+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:21.121 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:21.118+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:21.637 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:21.634+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:22.101 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:22.098+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:22.596 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:22.593+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:23.136 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:23.133+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:23.591 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:23.588+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:24.145 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:24.142+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:24.562 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:24.560+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:25.185 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:25.182+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:25.563 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:25.560+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:26.157 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:26.154+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:26.599 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:26.596+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:27.164 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:27.162+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:27.648 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:27.646+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:28.116 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:28.114+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:28.696 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:28.694+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:29.081 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:29.079+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:29.717 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:29.715+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:30.066 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:30.064+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:30.751 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:30.749+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:31.097 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:31.095+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:31.760 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:31.758+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:32.104 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:32.102+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:32.711 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:32.709+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:33.071 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:33.069+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:33.712 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:33.709+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:34.033 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:34.031+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:34.694 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:34.692+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:35.052 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:35.050+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:35.721 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:35.719+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:36.071 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:36.069+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:36.702 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:36.700+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:37.090 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:37.088+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:37.659 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:37.658+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:38.119 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:38.118+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:38.636 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:38.634+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:39.129 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:39.127+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:39.666 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:39.664+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:40.084 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:40.082+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:40.700 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:40.698+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:41.129 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:41.127+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:41.747 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:41.745+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:42.171 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:42.169+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:42.773 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:42.771+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:43.188 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:43.186+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:43.748 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:43.746+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:44.194 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:44.192+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:44.725 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:44.723+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:45.190 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:45.188+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:45.708 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:45.706+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:46.196 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:46.194+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:46.692 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:46.690+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:47.230 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:47.228+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:47.666 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:47.664+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:48.205 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:48.203+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:48.633 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:48.631+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:49.172 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:49.170+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:49.609 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:49.607+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:50.206 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:50.204+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:50.572 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:50.570+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:51.249 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:51.247+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:51.533 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:51.532+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:52.284 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:52.282+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:52.580 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:52.578+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:53.263 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:53.261+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:53.580 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:53.578+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:54.247 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:54.245+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:54.535 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:54.533+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:55.266 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:55.264+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:55.536 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:55.534+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:56.261 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:56.259+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:56.564 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:56.562+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:57.219 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:57.217+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:57.539 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:57.537+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:58.222 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:58.220+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:58.556 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:58.554+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:50:59.244 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:50:59.242+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:50:59.509 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:50:59.507+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:00.211 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:00.209+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:00.502 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:00.500+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:01.200 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:01.198+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:01.506 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:01.503+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:02.178 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:02.175+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:02.529 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:02.525+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:03.226 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:03.224+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:03.499 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:03.496+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:04.269 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:04.266+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:04.530 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:04.527+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:05.224 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:05.221+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:05.575 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:05.573+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:06.179 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:06.176+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:06.527 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:06.524+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:07.144 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:07.141+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:07.482 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:07.479+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:08.149 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:08.146+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:08.458 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:08.455+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:09.190 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:09.187+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:09.437 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:09.434+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:10.233 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:10.231+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:10.431 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:10.429+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:11.209 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:11.207+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:11.389 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:11.387+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:12.176 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:12.174+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:12.388 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:12.387+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:13.145 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:13.143+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:13.405 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:13.403+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:14.160 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:14.158+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:14.399 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:14.397+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:15.175 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:15.173+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:15.420 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:15.418+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:16.151 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:16.149+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:16.400 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:16.398+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:17.181 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:17.179+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:17.435 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:17.433+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:18.217 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:18.215+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:18.480 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:18.478+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:19.243 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:19.241+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:19.477 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:19.475+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:20.238 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:20.237+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:20.484 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:20.482+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:21.256 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:21.254+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:21.462 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:21.460+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:22.281 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:22.279+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:22.434 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:22.432+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:23.298 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:23.296+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:23.456 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:23.454+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:24.321 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:24.319+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:24.428 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:24.426+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:25.298 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:25.296+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:25.416 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:25.414+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:26.333 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:26.331+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:26.449 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:26.447+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:27.315 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:27.313+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:27.427 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:27.425+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:28.326 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:28.324+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:28.378 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:28.377+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:29.315 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:29.313+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:29.373 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:29.371+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:30.299 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:30.297+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:30.357 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:30.355+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:31.312 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:31.310+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:31.333 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:31.331+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:32.293 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:32.291+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:32.330 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:32.328+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:33.251 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:33.245+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:33.331 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:33.329+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:34.255 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:34.253+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:34.288 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:34.286+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:35.238 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:35.237+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:35.336 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:35.335+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:36.232 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:36.230+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:36.382 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:36.380+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:37.222 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:37.220+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:37.427 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:37.425+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:38.226 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:38.224+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:38.385 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:38.383+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:39.261 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:39.259+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:39.344 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:39.342+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:40.252 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:40.250+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:40.297 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:40.295+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:41.239 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:41.237+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:41.325 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:41.324+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:42.246 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:42.245+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:42.363 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:42.361+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:43.269 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:43.267+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:43.327 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:43.325+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:44.281 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:44.279+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:44.367 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:44.365+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:45.258 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:45.255+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:45.325 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:45.322+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:46.226 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:46.224+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:46.283 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:46.280+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:47.184 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:47.181+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:47.316 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:47.313+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:48.228 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:48.225+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:48.271 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:48.268+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:49.228 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:49.226+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:49.300 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:49.297+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:50.229 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:50.226+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:50.325 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:50.322+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:51.267 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:51.264+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:51.355 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:51.352+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:52.288 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:52.285+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:52.404 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:52.402+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:53.294 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:53.292+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:53.372 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:53.369+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:54.319 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:54.317+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:54.419 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:54.417+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:55.365 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:55.363+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:55.397 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:55.396+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:56.407 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:56.405+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:56.431 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:56.429+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:57.429 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:57.427+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:57.438 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:57.437+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:58.385 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:58.383+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:58.392 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:58.390+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:51:59.379 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:51:59.376+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:51:59.417 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:51:59.414+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:00.341 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:00.339+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:00.456 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:00.454+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:01.300 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:01.298+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:01.448 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:01.446+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:02.298 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:02.296+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:02.483 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:02.481+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:03.326 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:03.325+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:03.449 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:03.447+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:04.335 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:04.333+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:04.476 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:04.474+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:05.349 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:05.347+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:05.432 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:05.430+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:06.399 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:06.397+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:06.467 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:06.465+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:07.398 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:07.396+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:07.449 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:07.447+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:08.368 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:08.366+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:08.491 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:08.489+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:09.418 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:09.416+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:09.468 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:09.467+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:10.376 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:10.374+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:10.440 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:10.438+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:11.387 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:11.385+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:11.410 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:11.408+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:12.413 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:12.411+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:12.442 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:12.441+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:13.433 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:13.431+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:13.448 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:13.447+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:14.408 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:14.406+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:14.463 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:14.462+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:15.445 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:15.443+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:15.503 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:15.501+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:16.409 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:16.405+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:16.491 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:16.489+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:17.434 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:17.432+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:17.487 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:17.484+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:18.441 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:18.439+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:18.449 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:18.447+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:19.409 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:19.407+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:19.427 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:19.425+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:20.426 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:20.424+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:20.433 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:20.431+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:21.377 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:21.375+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:21.433 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:21.431+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:22.380 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:22.377+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:22.450 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:22.448+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:23.400 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:23.398+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:23.499 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:23.497+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:24.390 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:24.388+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:24.536 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:24.534+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:25.363 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:25.361+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:25.535 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:25.533+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:26.361 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:26.358+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:26.575 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:26.573+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:27.353 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:27.351+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:27.591 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:27.589+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:28.370 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:28.367+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:28.598 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:28.596+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:29.347 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:29.344+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:29.609 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:29.606+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:30.375 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:30.372+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:30.605 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:30.602+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:31.389 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:31.386+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:31.601 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:31.598+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:32.439 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:32.436+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:32.599 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:32.596+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:33.472 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:33.469+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:33.587 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:33.584+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:34.487 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:34.484+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:34.620 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:34.618+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:35.458 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:35.455+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:35.621 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:35.618+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:36.473 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:36.470+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:36.581 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:36.579+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:37.435 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:37.432+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:37.573 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:37.570+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:38.421 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:38.419+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:38.548 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:38.546+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:39.384 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:39.382+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:39.511 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:39.509+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:40.338 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:40.336+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:40.547 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:40.545+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:41.386 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:41.384+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:41.594 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:41.592+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:42.341 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:42.339+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:42.638 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:42.636+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:43.335 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:43.333+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:43.645 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:43.643+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:44.305 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:44.304+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:44.600 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:44.598+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:45.352 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:45.350+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:45.608 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:45.606+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:46.337 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:46.336+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:46.560 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:46.558+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:47.377 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:47.375+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:47.561 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:47.558+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:48.352 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:48.350+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:48.577 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:48.575+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:49.362 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:49.360+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:49.608 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:49.606+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:50.354 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:50.352+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:50.620 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:50.618+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:51.386 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:51.384+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:51.627 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:51.625+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:52.403 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:52.401+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:52.594 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:52.592+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:53.374 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:53.372+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:53.588 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:53.586+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:54.362 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:54.360+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:54.551 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:54.549+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:55.402 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:55.400+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:55.532 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:55.530+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:56.427 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:56.425+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:56.486 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:56.484+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:57.440 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:57.438+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:57.514 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:57.511+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:58.434 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:58.432+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:58.530 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:58.528+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:52:59.455 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:52:59.453+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:52:59.544 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:52:59.542+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:00.462 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:00.460+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:00.505 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:00.502+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:01.506 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:01.504+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:01.540 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:01.538+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:02.525 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:02.523+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:02.529 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:02.528+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:03.492 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:03.490+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:03.554 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:03.552+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:04.539 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:04.537+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:04.570 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:04.568+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:05.559 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:05.557+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:05.582 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:05.580+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:06.591 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:06.589+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:06.604 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:06.602+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:07.544 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:07.542+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:07.619 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:07.617+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:08.498 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:08.496+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:08.639 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:08.637+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:09.502 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:09.500+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:09.682 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:09.680+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:10.526 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:10.524+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:10.645 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:10.643+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:11.560 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:11.558+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:11.626 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:11.624+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:12.593 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:12.590+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:12.672 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:12.669+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:13.586 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:13.583+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:13.709 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:13.707+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:14.539 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:14.536+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:14.699 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:14.696+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:15.577 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:15.574+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:15.665 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:15.661+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:16.581 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:16.578+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:16.689 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:16.686+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:17.600 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:17.597+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:17.656 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:17.653+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:18.584 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:18.581+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:18.630 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:18.627+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:19.553 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:19.548+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:19.620 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:19.617+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:20.532 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:20.530+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:20.632 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:20.629+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:21.514 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:21.512+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:21.636 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:21.634+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:22.514 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:22.512+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:22.645 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:22.643+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:23.505 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:23.502+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:23.676 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:23.674+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:24.521 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:24.519+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:24.694 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:24.692+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:25.512 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:25.510+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:25.724 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:25.722+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:26.560 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:26.558+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:26.705 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:26.703+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:27.591 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:27.589+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:27.687 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:27.685+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:28.602 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:28.600+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:28.733 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:28.731+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:29.627 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:29.625+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:29.784 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:29.782+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:30.649 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:30.647+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:30.743 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:30.742+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:31.632 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:31.630+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:31.794 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:31.792+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:32.612 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:32.610+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:32.750 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:32.748+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:33.579 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:33.577+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:33.780 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:33.778+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:34.582 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:34.580+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:34.765 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:34.764+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:35.609 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:35.607+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:35.762 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:35.760+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:36.628 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:36.626+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:36.716 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:36.714+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:37.605 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:37.603+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:37.737 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:37.735+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:38.609 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:38.607+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:38.706 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:38.704+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:39.630 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:39.628+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:39.736 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:39.734+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:40.643 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:40.641+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:40.786 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:40.784+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:41.649 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:41.647+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:41.753 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:41.751+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:42.635 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:42.634+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:42.786 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:42.784+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:43.602 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:43.600+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:43.790 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:43.788+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:44.619 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:44.617+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:44.764 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:44.762+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:45.608 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:45.606+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:45.787 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:45.785+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:46.653 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:46.651+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:46.829 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:46.827+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:47.623 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:47.621+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:47.780 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:47.778+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:48.661 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:48.659+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:48.797 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:48.795+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:49.648 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:49.646+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:49.767 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:49.766+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:50.682 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:50.680+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:50.725 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:50.723+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:51.683 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:51.681+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:51.685 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:51.683+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:52.697 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:52.695+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:52.725 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:52.723+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:53.681 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:53.679+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:53.740 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:53.738+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:54.648 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:54.646+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:54.699 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:54.697+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:55.669 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:55.666+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:55.692 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:55.689+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:56.700 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:56.691+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:56.717 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:56.714+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:57.670 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:57.661+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:57.735 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:57.732+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:58.626 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:58.623+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:58.752 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:58.749+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:53:59.586 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:53:59.583+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:53:59.740 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:53:59.737+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:00.554 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:00.551+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:00.767 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:00.764+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:01.535 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:01.532+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:01.721 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:01.718+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:02.528 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:02.525+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:02.737 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:02.734+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:03.501 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:03.498+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:03.736 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:03.733+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:04.517 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:04.515+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:04.777 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:04.775+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:05.543 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:05.541+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:05.809 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:05.807+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:06.511 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:06.509+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:06.833 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:06.829+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:07.479 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:07.477+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:07.866 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:07.864+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:08.493 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:08.491+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:08.855 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:08.853+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:09.493 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:09.491+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:09.848 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:09.847+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:10.505 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:10.503+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:10.889 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:10.887+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:11.471 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:11.469+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:11.932 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:11.930+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:12.467 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:12.465+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:12.965 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:12.963+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:13.514 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:13.512+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:13.968 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:13.967+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:14.553 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:14.551+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:15.001 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:15.000+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:15.514 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:15.512+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:16.026 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:16.024+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:16.527 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:16.525+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:16.979 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:16.977+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:17.531 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:17.529+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:17.953 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:17.951+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:18.549 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:18.547+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:18.905 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:18.903+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:19.542 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:19.540+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:19.905 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:19.903+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:20.573 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:20.571+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:20.917 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:20.915+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:21.541 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:21.539+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:21.876 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:21.874+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:22.541 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:22.539+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:22.891 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:22.889+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:23.496 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:23.494+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:23.860 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:23.857+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:24.533 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:24.530+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:24.849 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:24.847+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:25.533 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:25.531+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:25.842 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:25.841+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:26.537 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:26.535+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:26.819 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:26.817+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:27.534 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:27.532+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:27.812 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:27.810+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:28.487 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:28.485+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:28.808 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:28.806+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:29.443 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:29.441+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:29.832 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:29.830+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:30.465 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:30.463+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:30.843 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:30.841+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:31.439 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:31.437+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:31.801 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:31.799+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:32.421 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:32.419+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:32.844 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:32.842+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:33.461 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:33.459+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:33.798 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:33.796+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:34.461 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:34.458+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:34.817 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:34.815+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:35.489 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:35.487+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:35.842 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:35.840+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:36.505 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:36.503+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:36.839 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:36.837+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:37.463 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:37.461+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:37.805 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:37.803+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:38.486 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:38.485+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:38.777 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:38.774+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:39.472 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:39.469+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:39.762 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:39.759+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:40.425 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:40.422+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:40.749 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:40.746+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:41.444 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:41.441+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:41.764 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:41.761+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:42.470 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:42.467+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:42.779 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:42.776+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:43.472 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:43.469+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:43.760 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:43.757+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:44.460 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:44.457+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:44.732 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:44.730+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:45.464 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:45.461+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:45.773 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:45.770+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:46.421 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:46.418+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:46.724 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:46.721+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:47.376 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:47.373+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:47.682 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:47.679+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:48.360 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:48.358+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:48.645 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:48.643+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:49.377 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:49.375+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:49.638 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:49.636+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:50.387 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:50.385+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:50.646 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:50.644+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:51.361 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:51.359+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:51.637 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:51.635+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:52.395 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:52.393+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:52.609 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:52.607+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:53.363 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:53.361+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:53.623 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:53.621+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:54.339 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:54.337+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:54.587 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:54.585+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:55.381 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:55.379+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:55.619 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:55.617+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:56.412 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:56.410+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:56.578 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:56.577+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:57.404 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:57.402+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:57.613 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:57.611+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:58.446 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:58.444+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:58.569 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:58.567+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:54:59.459 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:54:59.457+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:54:59.521 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:54:59.519+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:00.471 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:00.469+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:00.517 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:00.515+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:01.455 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:01.453+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:01.487 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:01.485+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:02.418 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:02.416+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:02.457 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:02.455+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:03.396 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:03.394+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:03.450 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:03.448+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:04.369 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:04.367+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:04.407 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:04.405+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:05.394 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:05.393+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:05.421 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:05.419+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:06.422 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:06.420+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:06.443 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:06.441+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:07.396 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:07.395+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:07.443 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:07.441+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:08.398 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:08.397+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:08.432 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:08.430+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:09.385 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:09.383+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:09.480 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:09.478+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:10.419 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:10.417+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:10.519 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:10.517+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:11.449 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:11.447+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:11.474 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:11.473+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:12.445 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:12.443+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:12.504 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:12.503+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:13.481 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:13.479+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:13.552 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:13.550+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:14.530 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:14.528+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:14.581 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:14.579+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:15.537 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:15.535+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:15.567 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:15.565+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:16.554 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:16.553+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:16.584 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:16.582+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:17.515 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:17.513+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:17.541 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:17.539+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:18.495 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:18.493+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:18.582 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:18.580+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:19.523 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:19.521+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:19.608 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:19.607+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:20.530 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:20.528+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:20.584 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:20.582+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:21.565 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:21.563+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:21.579 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:21.577+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:22.597 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:22.594+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:22.602 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:22.600+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:23.576 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:23.573+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:23.610 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:23.608+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:24.535 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:24.532+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:24.608 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:24.605+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:25.569 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:25.566+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:25.638 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:25.635+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:26.550 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:26.547+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:26.633 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:26.630+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:27.585 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:27.582+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:27.638 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:27.636+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:28.570 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:28.567+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:28.626 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:28.623+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:29.617 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:29.614+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:29.665 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:29.662+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:30.617 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:30.614+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:30.646 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:30.644+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:31.643 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:31.641+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:31.669 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:31.667+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:32.605 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:32.603+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:32.706 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:32.704+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:33.654 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:33.652+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:33.685 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:33.683+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:34.619 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:34.617+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:34.721 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:34.719+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:35.643 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:35.641+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:35.730 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:35.729+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:36.687 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:36.685+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:36.725 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:36.723+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:37.650 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:37.648+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:37.748 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:37.746+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:38.671 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:38.669+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:38.772 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:38.770+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:39.688 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:39.686+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:39.744 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:39.743+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:40.697 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:40.695+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:40.706 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:40.704+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:41.709 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:41.707+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:41.747 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:41.745+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:42.700 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:42.698+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:42.714 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:42.712+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:43.713 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:43.711+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:43.720 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:43.719+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:44.703 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:44.701+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:44.758 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:44.755+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:45.720 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:45.719+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:45.771 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:45.769+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:46.718 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:46.716+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:46.793 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:46.791+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:47.724 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:47.722+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:47.823 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:47.821+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:48.743 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:48.741+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:48.818 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:48.816+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:49.714 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:49.711+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:49.819 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:49.817+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:50.669 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:50.667+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:50.863 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:50.861+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:51.695 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:51.693+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:51.905 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:51.903+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:52.656 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:52.654+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:52.942 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:52.940+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:53.670 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:53.668+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:53.966 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:53.965+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:54.717 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:54.715+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:54.931 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:54.929+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:55.748 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:55.746+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:55.896 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:55.894+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:56.718 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:56.716+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:56.885 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:56.883+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:57.748 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:57.746+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:57.915 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:57.913+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:58.787 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:58.785+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:58.918 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:58.916+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:55:59.819 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:55:59.817+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:55:59.942 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:55:59.940+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:00.827 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:00.825+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:00.975 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:00.973+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:01.833 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:01.831+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:01.964 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:01.962+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:02.875 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:02.873+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:02.921 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:02.919+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:03.921 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:03.919+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:03.942 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:03.940+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:04.925 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:04.922+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:04.925 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:04.923+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:05.912 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:05.909+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:05.936 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:05.933+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:06.907 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:06.904+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:06.943 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:06.940+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:07.860 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:07.857+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:07.895 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:07.892+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:08.865 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:08.862+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:08.896 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:08.893+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:09.865 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:09.862+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:09.872 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:09.870+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:10.850 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:10.847+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:10.880 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:10.877+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:11.883 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:11.880+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:11.921 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:11.918+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:12.912 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:12.909+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:12.934 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:12.931+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:13.930 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:13.927+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:13.932 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:13.929+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:14.905 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:14.903+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:14.982 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:14.980+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:15.912 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:15.910+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:15.989 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:15.987+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:16.866 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:16.864+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:16.964 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:16.962+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:17.869 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:17.867+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:17.959 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:17.957+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:18.839 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:18.837+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:18.967 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:18.965+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:19.873 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:19.871+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:19.921 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:19.919+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:20.828 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:20.826+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:20.909 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:20.907+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:21.780 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:21.778+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:21.877 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:21.875+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:22.791 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:22.789+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:22.880 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:22.877+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:23.781 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:23.779+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:23.892 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:23.891+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:24.777 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:24.775+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:24.869 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:24.867+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:25.781 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:25.779+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:25.879 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:25.877+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:26.808 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:26.806+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:26.901 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:26.899+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:27.840 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:27.838+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:27.854 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:27.853+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:28.854 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:28.852+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:28.865 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:28.863+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:29.845 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:29.843+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:29.879 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:29.877+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:30.881 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:30.879+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:30.910 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:30.908+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:31.847 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:31.845+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:31.869 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:31.867+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:32.816 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:32.814+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:32.829 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:32.827+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:33.774 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:33.772+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:33.858 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:33.857+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:34.762 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:34.760+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:34.820 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:34.818+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:35.755 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:35.753+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:35.843 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:35.841+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:36.759 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:36.757+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:36.861 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:36.859+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:37.734 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:37.732+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:37.871 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:37.869+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:38.709 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:38.707+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:38.895 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:38.893+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:39.757 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:39.755+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:39.944 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:39.942+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:40.759 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:40.757+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:40.980 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:40.978+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:41.744 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:41.742+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:41.973 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:41.971+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:42.758 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:42.756+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:42.977 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:42.975+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:43.735 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:43.733+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:43.972 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:43.970+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:44.747 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:44.745+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:45.010 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:45.008+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:45.753 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:45.751+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:46.015 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:46.013+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:46.760 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:46.759+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:47.010 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:47.008+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:47.736 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:47.734+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:48.045 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:48.043+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:48.731 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:48.728+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:49.035 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:49.032+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:49.710 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:49.706+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:49.993 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:49.990+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:50.682 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:50.679+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:51.014 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:51.011+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:51.663 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:51.660+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:52.018 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:52.015+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:52.658 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:52.655+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:53.060 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:53.057+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:53.700 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:53.697+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:54.072 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:54.069+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:54.706 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:54.703+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:55.027 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:55.024+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:55.679 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:55.676+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:56.025 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:56.022+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:56.644 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:56.641+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:56.981 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:56.978+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:57.597 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:57.594+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:58.004 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:58.002+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:58.593 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:58.591+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:58.969 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:58.966+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:56:59.611 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:56:59.609+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:56:59.994 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:56:59.992+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:00.563 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:00.561+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:00.988 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:00.986+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:01.560 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:01.558+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:01.952 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:01.950+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:02.608 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:02.606+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:02.910 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:02.908+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:03.640 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:03.638+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:03.941 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:03.939+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:04.644 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:04.642+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:04.970 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:04.968+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:05.683 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:05.681+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:05.984 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:05.982+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:06.694 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:06.692+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:06.943 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:06.941+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:07.691 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:07.689+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:07.894 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:07.892+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:08.700 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:08.698+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:08.904 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:08.902+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:09.743 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:09.741+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:09.938 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:09.936+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:10.715 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:10.713+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:10.964 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:10.961+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:11.682 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:11.681+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:12.010 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:12.008+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:12.635 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:12.633+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:12.980 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:12.978+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:13.591 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:13.589+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:13.952 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:13.950+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:14.580 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:14.578+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:14.916 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:14.914+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:15.617 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:15.615+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:15.950 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:15.948+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:16.645 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:16.643+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:16.980 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:16.978+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:17.660 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:17.658+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:18.026 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:18.024+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:18.662 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:18.660+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:18.978 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:18.976+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:19.657 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:19.655+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:20.018 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:20.016+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:20.644 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:20.642+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:21.010 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:21.008+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:21.676 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:21.674+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:21.972 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:21.970+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:22.725 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:22.723+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:22.946 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:22.944+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:23.680 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:23.678+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:23.935 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:23.933+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:24.640 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:24.638+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:24.931 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:24.929+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:25.620 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:25.618+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:25.962 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:25.959+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:26.667 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:26.665+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:26.928 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:26.926+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:27.715 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:27.713+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:27.902 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:27.900+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:28.760 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:28.758+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:28.885 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:28.883+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:29.746 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:29.744+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:29.910 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:29.908+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:30.748 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:30.746+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:30.925 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:30.923+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:31.787 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:31.784+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:31.913 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:31.910+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:32.743 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:32.740+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:32.947 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:32.944+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:33.754 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:33.751+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:33.972 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:33.969+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:34.748 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:34.745+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:34.925 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:34.922+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:35.752 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:35.749+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:35.955 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:35.952+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:36.755 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:36.752+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:36.943 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:36.940+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:37.715 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:37.712+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:37.902 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:37.899+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:38.763 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:38.760+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:38.915 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:38.912+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:39.742 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:39.739+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:39.866 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:39.864+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:40.722 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:40.720+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:40.894 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:40.892+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:41.717 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:41.715+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:41.923 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:41.921+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:42.747 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:42.745+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:42.890 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:42.888+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:43.762 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:43.760+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:43.894 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:43.892+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:44.793 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:44.791+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:44.918 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:44.916+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:45.814 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:45.812+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:45.928 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:45.926+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:46.772 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:46.770+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:46.948 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:46.946+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:47.802 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:47.800+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:47.905 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:47.903+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:48.808 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:48.806+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:48.899 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:48.897+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:49.773 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:49.771+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:49.894 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:49.892+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:50.732 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:50.730+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:50.941 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:50.940+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:51.746 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:51.744+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:51.982 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:51.980+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:52.772 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:52.770+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:53.010 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:53.008+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:53.747 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:53.745+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:54.004 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:54.002+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:54.714 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:54.712+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:55.022 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:55.020+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:55.719 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:55.717+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:55.986 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:55.984+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:56.704 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:56.702+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:56.997 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:56.995+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:57.714 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:57.712+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:57.981 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:57.979+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:58.740 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:58.738+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:58.939 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:58.937+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:57:59.748 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:57:59.745+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:57:59.896 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:57:59.894+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:00.759 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:00.757+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:00.870 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:00.868+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:01.796 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:01.794+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:01.867 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:01.865+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:02.824 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:02.822+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:02.858 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:02.856+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:03.823 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:03.821+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:03.870 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:03.868+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:04.854 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:04.852+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:04.863 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:04.861+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:05.812 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:05.810+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:05.839 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:05.837+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:06.841 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:06.839+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:06.844 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:06.842+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:07.825 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:07.823+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:07.883 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:07.881+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:08.821 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:08.819+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:08.905 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:08.903+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:09.801 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:09.799+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:09.870 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:09.868+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:10.827 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:10.825+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:10.859 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:10.857+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:11.827 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:11.825+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:11.846 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:11.844+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:12.809 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:12.807+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:12.814 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:12.812+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:13.820 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:13.818+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:13.821 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:13.819+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:14.794 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:14.791+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:14.854 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:14.851+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:15.807 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:15.804+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:15.870 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:15.867+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:16.762 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:16.759+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:16.858 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:16.855+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:17.810 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:17.807+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:17.849 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:17.846+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:18.825 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:18.822+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:18.841 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:18.838+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:19.868 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:19.865+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:19.875 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:19.872+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:20.832 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:20.829+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:20.913 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:20.910+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:21.866 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:21.863+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:21.881 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:21.879+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:22.841 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:22.838+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:22.864 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:22.862+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:23.853 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:23.850+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:23.882 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:23.879+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:24.829 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:24.827+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:24.899 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:24.897+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:25.795 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:25.793+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:25.912 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:25.910+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:26.770 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:26.768+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:26.903 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:26.901+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:27.800 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:27.798+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:27.937 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:27.935+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:28.783 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:28.781+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:28.896 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:28.894+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:29.751 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:29.749+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:29.943 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:29.941+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:30.747 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:30.745+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:30.906 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:30.903+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:31.739 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:31.737+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:31.900 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:31.898+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:32.697 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:32.695+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:32.864 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:32.862+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:33.705 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:33.703+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:33.828 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:33.826+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:34.727 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:34.725+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:34.791 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:34.789+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:35.770 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:35.768+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:35.785 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:35.783+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:36.799 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:36.797+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:36.817 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:36.816+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:37.789 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:37.787+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:37.822 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:37.821+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:38.826 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:38.824+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:38.845 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:38.843+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:39.833 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:39.831+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:39.865 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:39.863+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:40.794 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:40.791+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:40.822 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:40.820+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:41.814 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:41.812+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:41.864 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:41.862+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:42.799 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:42.797+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:42.902 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:42.900+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:43.819 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:43.817+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:43.903 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:43.901+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:44.783 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:44.781+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:44.920 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:44.918+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:45.745 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:45.743+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:45.933 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:45.931+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:46.722 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:46.720+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:46.897 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:46.895+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:47.765 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:47.763+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:47.884 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:47.882+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:48.763 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:48.761+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:48.909 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:48.907+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:49.787 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:49.785+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:49.951 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:49.949+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:50.739 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:50.737+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:50.951 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:50.949+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:51.776 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:51.774+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:51.934 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:51.932+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:52.751 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:52.749+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:52.977 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:52.975+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:53.711 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:53.709+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:53.934 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:53.932+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:54.673 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:54.671+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:54.940 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:54.938+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:55.662 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:55.660+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:55.943 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:55.941+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:56.669 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:56.667+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:56.915 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:56.913+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:57.692 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:57.689+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:57.878 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:57.875+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:58.680 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:58.677+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:58.880 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:58.877+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:58:59.716 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:58:59.713+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:58:59.922 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:58:59.919+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:00.751 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:00.748+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:00.898 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:00.895+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:01.795 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:01.792+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:01.942 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:01.939+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:02.777 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:02.774+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:02.915 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:02.913+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:03.816 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:03.813+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:03.899 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:03.896+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:04.800 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:04.798+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:04.910 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:04.907+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:05.751 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:05.749+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:05.943 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:05.940+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:06.762 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:06.759+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:06.969 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:06.967+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:07.762 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:07.760+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:07.982 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:07.980+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:08.756 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:08.754+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:08.962 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:08.960+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:09.735 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:09.733+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:09.956 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:09.954+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:10.749 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:10.747+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:10.959 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:10.957+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:11.701 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:11.699+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:11.987 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:11.985+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:12.708 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:12.706+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:12.974 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:12.972+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:13.692 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:13.690+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:13.995 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:13.994+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:14.714 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:14.712+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:15.011 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:15.009+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:15.672 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:15.670+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:16.028 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:16.026+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:16.699 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:16.697+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:17.005 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:17.003+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:17.654 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:17.652+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:17.962 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:17.960+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:18.638 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:18.635+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:18.979 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:18.977+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:19.684 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:19.682+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:19.949 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:19.946+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:20.658 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:20.656+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:20.976 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:20.974+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:21.643 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:21.641+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:21.941 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:21.938+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:22.651 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:22.649+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:22.915 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:22.913+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:23.641 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:23.639+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:23.931 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:23.929+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:24.631 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:24.629+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:24.968 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:24.966+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:25.666 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:25.664+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:25.968 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:25.966+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:26.685 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:26.683+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:26.934 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:26.932+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:27.708 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:27.706+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:27.972 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:27.970+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:28.718 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:28.716+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:28.941 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:28.939+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:29.710 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:29.708+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:29.951 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:29.949+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:30.681 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:30.679+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:30.914 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:30.912+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:31.668 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:31.666+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:31.921 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:31.919+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:32.620 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:32.618+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:32.952 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:32.949+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:33.663 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:33.661+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:33.968 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:33.966+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:34.651 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:34.649+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:34.928 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:34.926+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:35.634 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:35.632+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:35.904 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:35.902+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:36.652 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:36.650+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:36.888 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:36.886+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:37.615 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:37.613+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:37.873 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:37.871+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:38.605 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:38.603+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:38.892 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:38.890+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:39.642 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:39.640+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:39.925 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:39.923+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:40.601 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:40.599+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:40.964 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:40.961+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:41.622 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:41.619+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:41.947 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:41.944+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:42.656 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:42.652+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:42.940 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:42.937+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:43.656 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:43.653+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:43.977 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:43.974+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:44.615 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:44.612+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:44.961 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:44.958+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:45.596 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:45.593+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:45.936 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:45.933+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:46.644 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:46.641+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:46.965 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:46.962+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:47.649 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:47.646+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:47.995 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:47.992+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:48.681 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:48.678+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:48.947 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:48.944+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:49.661 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:49.659+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:49.917 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:49.915+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:50.691 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:50.689+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:50.891 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:50.889+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:51.654 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:51.652+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:51.899 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:51.897+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:52.677 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:52.675+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:52.863 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:52.861+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:53.631 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:53.629+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:53.885 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:53.883+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:54.663 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:54.661+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:54.857 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:54.855+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:55.628 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:55.626+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:55.815 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:55.813+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:56.678 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:56.676+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:56.807 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:56.805+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:57.647 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:57.645+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:57.833 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:57.830+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:58.690 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:58.688+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:58.817 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:58.815+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T15:59:59.643 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T15:59:59.641+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T15:59:59.803 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T15:59:59.801+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:00.671 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:00.669+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:00.804 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:00.802+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:01.629 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:01.627+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:01.779 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:01.777+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:02.608 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:02.606+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:02.733 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:02.731+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:03.614 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:03.612+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:03.685 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:03.683+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:04.654 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:04.652+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:04.692 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:04.690+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:05.694 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:05.692+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:05.740 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:05.738+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:06.647 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:06.645+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:06.768 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:06.766+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:07.665 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:07.663+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:07.791 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:07.789+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:08.713 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:08.711+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:08.809 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:08.807+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:09.752 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:09.750+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:09.783 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:09.781+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:10.766 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:10.763+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:10.791 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:10.789+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:11.737 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:11.735+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:11.816 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:11.814+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:12.746 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:12.744+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:12.827 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:12.825+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:13.783 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:13.781+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:13.798 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:13.796+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:14.771 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:14.769+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:14.772 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:14.770+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:15.746 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:15.743+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:15.747 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:15.745+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:16.705 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:16.703+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:16.728 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:16.726+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:17.730 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:17.728+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:17.736 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:17.734+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:18.757 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:18.755+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:18.773 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:18.771+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:19.741 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:19.739+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:19.787 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:19.785+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:20.751 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:20.749+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:20.791 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:20.789+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:21.725 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:21.723+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:21.824 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:21.822+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:22.739 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:22.737+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:22.803 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:22.801+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:23.779 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:23.776+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:23.849 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:23.846+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:24.827 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:24.824+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:24.854 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:24.851+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:25.863 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:25.859+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:25.897 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:25.894+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:26.907 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:26.904+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:26.907 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:26.904+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:27.861 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:27.858+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:27.953 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:27.950+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:28.874 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:28.871+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:28.934 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:28.931+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:29.916 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:29.913+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:29.977 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:29.973+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:30.961 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:30.958+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:30.988 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:30.985+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:31.941 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:31.938+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:31.971 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:31.969+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:32.974 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:32.971+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:32.989 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:32.987+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:33.483 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T16:00:33.481+0000 7fa2a9acd700 0 -- 172.21.15.123:0/1871504539 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x5638b44c5610 msgr2=0x7fa28c03b170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T16:00:33.484 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T16:00:33.482+0000 7fa2a9acd700 0 -- 172.21.15.123:0/1871504539 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x5638b4523490 msgr2=0x7fa28c0b1a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T16:00:33.983 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:33.981+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:34.008 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:34.006+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:35.006 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:35.004+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:35.011 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:35.009+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:36.006 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:36.003+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:36.035 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:36.033+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:37.006 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:37.004+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:37.056 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:37.054+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:38.040 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:38.038+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:38.082 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:38.080+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:39.068 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:39.066+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:39.076 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:39.075+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:40.057 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:40.055+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:40.081 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:40.079+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:41.083 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:41.081+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:41.084 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:41.082+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:42.044 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:42.042+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:42.060 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:42.058+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:43.003 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:43.001+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:43.050 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:43.048+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:43.993 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:43.991+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:44.044 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:44.042+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:44.979 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:44.977+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:45.021 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:45.019+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:45.950 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:45.948+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:46.025 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:46.023+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:46.960 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:46.958+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:47.069 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:47.067+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:47.956 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:47.953+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:48.096 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:48.094+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:48.946 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:48.944+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:49.109 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:49.107+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:49.962 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:49.959+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:50.075 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:50.073+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:50.947 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:50.945+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:51.093 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:51.091+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:51.961 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:51.959+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:52.113 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:52.111+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:52.951 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:52.949+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:53.069 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:53.067+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:53.937 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:53.935+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:54.087 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:54.085+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:54.977 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:54.975+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:55.071 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:55.069+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:55.957 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:55.955+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:56.068 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:56.065+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:56.934 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:56.932+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:57.031 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:57.029+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:57.925 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:57.923+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:57.985 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:57.983+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:58.888 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:58.886+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:00:59.026 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:00:59.024+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:00:59.865 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:00:59.863+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:00.069 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:00.067+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:00.911 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:00.909+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:01.042 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:01.040+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:01.896 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:01.894+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:02.057 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:02.055+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:02.909 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:02.907+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:03.051 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:03.049+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:03.933 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:03.931+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:04.038 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:04.036+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:04.945 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:04.943+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:05.027 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:05.025+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:05.974 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:05.972+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:06.011 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:06.009+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:07.018 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:07.014+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:07.043 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:07.040+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:08.024 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:08.021+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:08.057 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:08.054+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:09.015 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:09.012+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:09.056 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:09.053+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:09.995 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:09.992+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:10.094 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:10.091+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:11.009 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:11.006+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:11.110 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:11.107+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:12.002 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:11.999+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:12.161 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:12.158+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:13.049 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:13.046+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:13.209 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:13.206+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:14.003 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:14.000+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:14.257 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:14.254+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:15.036 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:15.033+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:15.245 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:15.242+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:16.023 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:16.021+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:16.236 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:16.234+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:17.058 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:17.056+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:17.268 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:17.266+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:18.047 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:18.045+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:18.299 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:18.297+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:19.036 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:19.034+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:19.340 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:19.338+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:20.072 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:20.070+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:20.310 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:20.308+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:21.068 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:21.066+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:21.312 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:21.310+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:22.048 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:22.046+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:22.338 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:22.336+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:23.013 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:23.010+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:23.318 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:23.314+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:23.972 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:23.970+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:24.292 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:24.289+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:24.983 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:24.981+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:25.341 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:25.339+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:25.964 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:25.962+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:26.374 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:26.372+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:26.942 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:26.940+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:27.357 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:27.355+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:27.948 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:27.946+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:28.402 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:28.400+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:28.949 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:28.947+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:29.376 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:29.374+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:29.949 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:29.947+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:30.330 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:30.328+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:30.950 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:30.948+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:31.372 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:31.370+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:31.906 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:31.901+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:32.362 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:32.360+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:32.859 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:32.857+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:33.401 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:33.399+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:33.821 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:33.819+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:34.382 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:34.380+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:34.850 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:34.848+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:35.408 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:35.406+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:35.812 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:35.810+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:36.420 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:36.418+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:36.860 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:36.858+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:37.442 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:37.440+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:37.816 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:37.814+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:38.416 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:38.414+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:38.827 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:38.825+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:39.446 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:39.444+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:39.828 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:39.826+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:40.410 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:40.408+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:40.842 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:40.840+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:41.403 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:41.401+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:41.889 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:41.886+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:42.446 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:42.443+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:42.926 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:42.924+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:43.462 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:43.460+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:43.940 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:43.938+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:44.512 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:44.510+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:44.898 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:44.895+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:45.544 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:45.541+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:45.882 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:45.879+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:46.518 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:46.516+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:46.896 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:46.893+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:47.523 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:47.521+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:47.880 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:47.877+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:48.496 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:48.494+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:48.914 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:48.912+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:49.513 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:49.511+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:49.944 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:49.941+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:50.516 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:50.513+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:50.959 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:50.956+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:51.508 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:51.505+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:51.955 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:51.952+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:52.551 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:52.548+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:52.940 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:52.937+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:53.508 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:53.505+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:53.904 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:53.901+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:54.526 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:54.523+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:54.944 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:54.941+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:55.482 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:55.479+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:55.946 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:55.943+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:56.462 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:56.459+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:56.928 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:56.925+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:57.461 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:57.458+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:57.879 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:57.877+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:58.490 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:58.488+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:58.895 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:58.893+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:01:59.494 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:01:59.492+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:01:59.891 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:01:59.889+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:00.513 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:00.511+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:00.932 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:00.930+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:01.504 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:01.502+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:01.906 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:01.904+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:02.535 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:02.533+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:02.922 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:02.920+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:03.490 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:03.488+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:03.949 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:03.947+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:04.470 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:04.468+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:04.970 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:04.968+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:05.489 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:05.487+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:05.961 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:05.959+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:06.491 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:06.489+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:06.912 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:06.910+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:07.474 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:07.472+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:07.874 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:07.872+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:08.505 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:08.503+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:08.869 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:08.867+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:09.502 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:09.500+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:09.864 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:09.862+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:10.516 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:10.514+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:10.912 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:10.911+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:11.517 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:11.515+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:11.867 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:11.865+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:12.510 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:12.508+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:12.852 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:12.850+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:13.477 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:13.475+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:13.811 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:13.809+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:14.518 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:14.516+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:14.771 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:14.769+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:15.502 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:15.500+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:15.740 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:15.738+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:16.484 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:16.483+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:16.693 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:16.691+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:17.452 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:17.450+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:17.666 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:17.664+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:18.482 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:18.479+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:18.657 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:18.655+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:19.456 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:19.454+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:19.614 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:19.612+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:20.475 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:20.473+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:20.597 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:20.595+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:21.486 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:21.481+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:21.558 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:21.556+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:22.494 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:22.492+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:22.553 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:22.551+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:23.475 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:23.474+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:23.507 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:23.506+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:24.459 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:24.458+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:24.550 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:24.548+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:25.470 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:25.468+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:25.592 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:25.590+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:26.478 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:26.476+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:26.557 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:26.554+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:27.450 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:27.448+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:27.555 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:27.553+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:28.444 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:28.442+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:28.513 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:28.512+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:29.473 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:29.472+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:29.559 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:29.557+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:30.429 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:30.427+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:30.592 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:30.590+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:31.477 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:31.474+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:31.579 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:31.577+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:32.458 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:32.456+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:32.628 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:32.625+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:33.414 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:33.411+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:33.640 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:33.637+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:34.410 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:34.407+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:34.661 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:34.659+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:35.425 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:35.422+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:35.664 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:35.661+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:36.437 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:36.433+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:36.659 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:36.656+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:37.406 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:37.403+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:37.629 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:37.626+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:38.362 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:38.359+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:38.594 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:38.591+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:39.343 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:39.332+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:39.638 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:39.635+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:40.291 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:40.288+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:40.607 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:40.603+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:41.331 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:41.328+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:41.586 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:41.583+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:42.335 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:42.334+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:42.557 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:42.555+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:43.379 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:43.377+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:43.509 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:43.508+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:44.411 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:44.409+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:44.489 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:44.487+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:45.441 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:45.438+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:45.444 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:45.443+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:46.437 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:46.435+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:46.474 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:46.472+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:47.438 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:47.437+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:47.463 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:47.461+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:48.436 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:48.434+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:48.488 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:48.486+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:49.466 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:49.464+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:49.537 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:49.535+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:50.443 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:50.442+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:50.565 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:50.564+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:51.429 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:51.428+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:51.522 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:51.520+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:52.465 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:52.463+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:52.473 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:52.472+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:53.455 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:53.454+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:53.487 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:53.485+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:54.443 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:54.441+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:54.471 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:54.449+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:55.433 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:55.432+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:55.478 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:55.476+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:56.390 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:56.388+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:56.449 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:56.448+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:57.344 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:57.342+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:57.440 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:57.438+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:58.365 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:58.364+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:58.469 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:58.468+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:02:59.369 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:02:59.367+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:02:59.517 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:02:59.515+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:00.339 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:00.337+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:00.528 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:00.526+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:01.358 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:01.356+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:01.577 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:01.575+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:02.335 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:02.333+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:02.620 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:02.618+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:03.333 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:03.331+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:03.632 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:03.630+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:04.379 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:04.377+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:04.602 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:04.601+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:05.353 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:05.351+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:05.578 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:05.576+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:06.359 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:06.357+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:06.543 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:06.542+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:07.345 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:07.343+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:07.515 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:07.514+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:08.325 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:08.324+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:08.474 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:08.472+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:09.347 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:09.345+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:09.516 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:09.514+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:10.357 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:10.355+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:10.566 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:10.564+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:11.319 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:11.317+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:11.587 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:11.585+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:12.312 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:12.310+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:12.583 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:12.582+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:13.266 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:13.263+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:13.592 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:13.590+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:14.294 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:14.293+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:14.567 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:14.565+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:15.275 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:15.273+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:15.609 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:15.607+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:16.269 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:16.267+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:16.604 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:16.601+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:17.317 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:17.314+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:17.606 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:17.603+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:18.359 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:18.357+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:18.608 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:18.605+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:19.379 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:19.376+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:19.607 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:19.605+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:20.384 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:20.381+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:20.587 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:20.585+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:21.365 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:21.362+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:21.623 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:21.621+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:22.327 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:22.325+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:22.591 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:22.589+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:23.323 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:23.321+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:23.554 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:23.553+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:24.328 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:24.326+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:24.587 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:24.585+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:25.344 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:25.342+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:25.601 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:25.600+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:26.375 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:26.373+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:26.602 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:26.600+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:27.367 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:27.366+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:27.603 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:27.601+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:28.396 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:28.394+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:28.636 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:28.634+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:29.356 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:29.354+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:29.619 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:29.617+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:30.375 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:30.373+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:30.621 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:30.619+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:31.337 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:31.335+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:31.619 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:31.617+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:32.385 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:32.383+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:32.585 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:32.583+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:33.369 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:33.368+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:33.582 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:33.580+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:34.332 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:34.329+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:34.626 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:34.624+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:35.369 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:35.368+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:35.619 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:35.618+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:36.393 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:36.392+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:36.600 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:36.599+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:37.380 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:37.378+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:37.647 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:37.645+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:38.369 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:38.367+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:38.664 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:38.663+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:39.405 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:39.403+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:39.703 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:39.702+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:40.377 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:40.376+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:40.704 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:40.703+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:41.412 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:41.411+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:41.706 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:41.704+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:42.437 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:42.436+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:42.683 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:42.681+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:43.401 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:43.399+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:43.722 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:43.720+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:44.391 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:44.389+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:44.752 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:44.749+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:45.351 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:45.350+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:45.777 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:45.775+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:46.316 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:46.314+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:46.737 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:46.735+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:47.306 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:47.304+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:47.764 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:47.762+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:48.280 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:48.279+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:48.739 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:48.738+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:49.327 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:49.326+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:49.720 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:49.719+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:50.340 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:50.339+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:50.721 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:50.720+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:51.317 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:51.315+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:51.684 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:51.682+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:52.326 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:52.323+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:52.669 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:52.668+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:53.337 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:53.336+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:53.695 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:53.694+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:54.356 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:54.355+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:54.707 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:54.706+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:55.373 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:55.371+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:55.725 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:55.724+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:56.328 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:56.326+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:56.749 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:56.747+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:57.311 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:57.310+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:57.710 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:57.709+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:58.316 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:58.314+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:58.698 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:58.694+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:03:59.288 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:03:59.285+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:03:59.731 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:03:59.729+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:00.295 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:00.293+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:00.702 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:00.699+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:01.324 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:01.322+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:01.752 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:01.750+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:02.330 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:02.327+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:02.723 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:02.721+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:03.341 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:03.339+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:03.714 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:03.711+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:04.370 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:04.367+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:04.688 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:04.686+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:05.393 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:05.390+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:05.698 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:05.695+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:06.437 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:06.435+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:06.659 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:06.658+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:07.461 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:07.458+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:07.658 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:07.657+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:08.495 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:08.493+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:08.620 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:08.619+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:09.505 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:09.504+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:09.618 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:09.617+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:10.483 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:10.482+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:10.644 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:10.642+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:11.514 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:11.512+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:11.690 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:11.689+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:12.515 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:12.514+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:12.706 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:12.705+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:13.472 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:13.471+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:13.694 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:13.693+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:14.432 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:14.431+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:14.729 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:14.727+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:15.392 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:15.391+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:15.775 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:15.773+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:16.403 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:16.401+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:16.816 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:16.815+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:17.447 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:17.446+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:17.770 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:17.768+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:18.419 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:18.417+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:18.798 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:18.796+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:19.382 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:19.381+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:19.826 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:19.825+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:20.416 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:20.414+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:20.871 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:20.870+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:21.392 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:21.390+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:21.874 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:21.873+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:22.393 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:22.392+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:22.917 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:22.915+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:23.372 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:23.370+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:23.905 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:23.903+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:24.361 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:24.360+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:24.868 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:24.867+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:25.350 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:25.349+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:25.902 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:25.901+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:26.306 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:26.305+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:26.920 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:26.919+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:27.304 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:27.303+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:27.936 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:27.935+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:28.257 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:28.255+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:28.958 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:28.956+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:29.303 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:29.301+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:29.910 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:29.909+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:30.286 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:30.285+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:30.865 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:30.863+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:31.324 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:31.322+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:31.850 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:31.848+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:32.347 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:32.345+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:32.826 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:32.824+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:33.316 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:33.315+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:33.796 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:33.795+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:34.355 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:34.353+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:34.814 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:34.813+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:35.353 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:35.351+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:35.779 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:35.778+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:36.353 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:36.352+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:36.798 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:36.797+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:37.353 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:37.352+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:37.847 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:37.845+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:38.386 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:38.385+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:38.853 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:38.852+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:39.371 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:39.370+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:39.853 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:39.852+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:40.417 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:40.415+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:40.808 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:40.807+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:41.370 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:41.368+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:41.775 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:41.773+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:42.332 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:42.330+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:42.762 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:42.760+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:43.290 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:43.288+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:43.768 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:43.766+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:44.245 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:44.242+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:44.767 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:44.764+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:45.290 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:45.288+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:45.732 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:45.729+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:46.274 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:46.272+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:46.771 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:46.768+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:47.272 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:47.270+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:47.762 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:47.760+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:48.284 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:48.282+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:48.735 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:48.733+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:49.252 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:49.249+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:49.759 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:49.757+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:50.291 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:50.288+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:50.776 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:50.775+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:51.313 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:51.311+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:51.827 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:51.826+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:52.334 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:52.332+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:52.782 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:52.781+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:53.324 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:53.323+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:53.778 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:53.777+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:54.341 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:54.340+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:54.740 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:54.739+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:55.368 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:55.366+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:55.780 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:55.779+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:56.413 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:56.412+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:56.815 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:56.814+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:57.423 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:57.421+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:57.829 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:57.828+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:58.432 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:58.431+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:58.804 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:58.802+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:04:59.426 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:04:59.425+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:04:59.762 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:04:59.760+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:00.420 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:00.418+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:00.782 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:00.780+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:01.413 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:01.412+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:01.744 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:01.743+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:02.380 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:02.379+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:02.747 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:02.746+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:03.407 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:03.406+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:03.749 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:03.748+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:04.368 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:04.367+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:04.717 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:04.716+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:05.399 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:05.397+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:05.670 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:05.668+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:06.365 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:06.363+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:06.695 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:06.693+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:07.380 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:07.379+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:07.722 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:07.720+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:08.398 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:08.396+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:08.760 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:08.758+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:09.403 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:09.401+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:09.807 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:09.805+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:10.400 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:10.399+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:10.760 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:10.759+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:11.389 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:11.387+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:11.719 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:11.717+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:12.430 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:12.429+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:12.766 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:12.765+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:13.470 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:13.469+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:13.750 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:13.749+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:14.497 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:14.495+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:14.730 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:14.729+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:15.514 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:15.513+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:15.745 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:15.744+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:16.534 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:16.532+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:16.703 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:16.702+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:17.520 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:17.519+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:17.688 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:17.687+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:18.554 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:18.553+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:18.728 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:18.727+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:19.519 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:19.518+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:19.738 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:19.737+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:20.489 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:20.487+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:20.736 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:20.734+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:21.450 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:21.449+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:21.742 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:21.741+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:22.460 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:22.459+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:22.763 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:22.762+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:23.441 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:23.440+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:23.719 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:23.718+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:24.464 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:24.461+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:24.673 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:24.670+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:25.496 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:25.494+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:25.697 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:25.695+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:26.543 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:26.541+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:26.668 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:26.666+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:27.534 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:27.532+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:27.620 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:27.618+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:28.530 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:28.528+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:28.594 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:28.592+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:29.578 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:29.576+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:29.613 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:29.611+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:30.535 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:30.533+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:30.592 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:30.589+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:31.575 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:31.574+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:31.589 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:31.587+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:32.577 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:32.576+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:32.635 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:32.633+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:33.536 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:33.535+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:33.601 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:33.600+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:34.523 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:34.522+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:34.562 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:34.560+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:35.507 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:35.506+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:35.571 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:35.570+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:36.538 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:36.537+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:36.565 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:36.564+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:37.492 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:37.491+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:37.590 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:37.589+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:38.504 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:38.502+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:38.542 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:38.541+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:39.482 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:39.480+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:39.510 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:39.509+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:40.450 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:40.449+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:40.542 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:40.541+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:41.409 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:41.407+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:41.504 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:41.503+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:42.426 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:42.425+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:42.502 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:42.501+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:43.454 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:43.453+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:43.528 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:43.527+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:44.497 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:44.496+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:44.563 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:44.562+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:45.508 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:45.507+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:45.573 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:45.571+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:46.491 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:46.490+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:46.573 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:46.572+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:47.513 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:47.512+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:47.579 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:47.578+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:48.540 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:48.539+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:48.613 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:48.612+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:49.492 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:49.490+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:49.577 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:49.576+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:50.459 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:50.458+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:50.545 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:50.543+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:51.469 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:51.468+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:51.506 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:51.505+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:52.475 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:52.474+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:52.549 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:52.548+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:53.489 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:53.486+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:53.517 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:53.516+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:54.502 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:54.501+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:54.539 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:54.538+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:55.504 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:55.503+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:55.522 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:55.521+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:56.480 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:56.479+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:56.510 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:56.509+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:57.520 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:57.519+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:57.538 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:57.537+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:58.515 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:58.514+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:05:58.529 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:58.527+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:59.528 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:05:59.527+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:05:59.552 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:05:59.551+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:00.540 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:00.539+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:00.554 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:00.553+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:01.536 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:01.535+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:01.584 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:01.582+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:02.487 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:02.486+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:02.591 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:02.590+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:03.491 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:03.490+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:03.558 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:03.557+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:04.449 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:04.447+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:04.551 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:04.550+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:05.446 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:05.445+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:05.546 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:05.545+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:06.452 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:06.451+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:06.549 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:06.547+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:07.469 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:07.467+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:07.544 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:07.542+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:08.449 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:08.446+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:08.591 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:08.589+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:09.418 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:09.415+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:09.639 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:09.637+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:10.437 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:10.434+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:10.613 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:10.611+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:11.442 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:11.440+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:11.593 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:11.591+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:12.400 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:12.398+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:12.606 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:12.604+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:13.448 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:13.446+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:13.633 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:13.631+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:14.429 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:14.427+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:14.599 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:14.597+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:15.405 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:15.403+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:15.602 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:15.600+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:16.371 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:16.369+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:16.604 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:16.602+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:17.326 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:17.325+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:17.622 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:17.621+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:18.305 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:18.304+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:18.655 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:18.654+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:19.323 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:19.322+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:19.694 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:19.692+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:20.300 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:20.299+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:20.720 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:20.719+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:21.318 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:21.317+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:21.745 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:21.744+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:22.312 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:22.311+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:22.735 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:22.734+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:23.283 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:23.282+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:23.781 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:23.780+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:24.330 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:24.329+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:24.823 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:24.822+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:25.371 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:25.370+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:25.868 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:25.867+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:26.386 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:26.385+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:26.866 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:26.865+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:27.391 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:27.390+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:27.906 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:27.905+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:28.391 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:28.389+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:28.947 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:28.946+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:29.373 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:29.372+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:29.951 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:29.950+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:30.382 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:30.380+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:30.954 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:30.952+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:31.340 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:31.339+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:31.989 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:31.987+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:32.354 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:32.353+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:33.034 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:33.033+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:33.351 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:33.350+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:34.042 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:34.041+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:34.365 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:34.364+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:35.085 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:35.082+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:35.387 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:35.385+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:36.083 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:36.082+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:36.403 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:36.402+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:37.035 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:37.034+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:37.355 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:37.354+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:38.070 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:38.069+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:38.327 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:38.326+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:39.119 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:39.118+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:39.354 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:39.353+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:40.124 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:40.123+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:40.347 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:40.346+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:41.126 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:41.125+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:41.343 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:41.342+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:42.127 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:42.126+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:42.311 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:42.307+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:43.089 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:43.088+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:43.314 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:43.313+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:44.122 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:44.121+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:44.334 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:44.333+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:45.075 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:45.074+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:45.319 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:45.318+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:46.034 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:46.033+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:46.360 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:46.359+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:47.077 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:47.076+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:47.410 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:47.409+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:48.033 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:48.032+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:48.374 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:48.373+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:49.005 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:49.004+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:49.391 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:49.390+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:50.039 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:50.038+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:50.401 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:50.399+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:51.079 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:51.076+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:51.401 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:51.399+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:52.109 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:52.107+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:52.437 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:52.435+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:53.136 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:53.134+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:53.402 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:53.400+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:54.182 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:54.180+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:54.397 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:54.395+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:55.197 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:55.195+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:55.379 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:55.377+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:56.230 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:56.228+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:56.331 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:56.329+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:57.233 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:57.231+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:57.314 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:57.313+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:58.222 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:58.220+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:58.273 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:58.271+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:06:59.250 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:06:59.248+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:06:59.272 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:06:59.270+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:00.283 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:00.282+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:00.311 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:00.310+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:01.267 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:01.266+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:01.325 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:01.324+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:02.243 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:02.242+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:02.299 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:02.298+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:03.251 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:03.250+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:03.348 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:03.348+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:04.285 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:04.284+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:04.364 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:04.362+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:05.320 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:05.319+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:05.333 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:05.332+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:06.318 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:06.318+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:06.347 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:06.346+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:07.279 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:07.278+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:07.309 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:07.308+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:08.271 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:08.270+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:08.275 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:08.274+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:09.281 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:09.280+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:09.296 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:09.295+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:10.311 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:10.310+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:10.336 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:10.335+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:11.319 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:11.318+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:11.338 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:11.337+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:12.302 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:12.301+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:12.336 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:12.335+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:13.325 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:13.324+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:13.342 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:13.340+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:14.301 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:14.301+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:14.333 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:14.332+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:15.305 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:15.304+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:15.313 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:15.313+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:16.282 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:16.282+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:16.307 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:16.306+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:17.241 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:17.240+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:17.277 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:17.276+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:18.241 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:18.239+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:18.261 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:18.260+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:19.266 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:19.266+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:19.267 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:19.266+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:20.245 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:20.244+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:20.279 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:20.278+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:21.224 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:21.223+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:21.259 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:21.258+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:22.215 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:22.214+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:22.231 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:22.231+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:23.208 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:23.208+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:23.210 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:23.210+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:24.215 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:24.214+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:24.239 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:24.238+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:25.180 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:25.179+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:25.281 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:25.280+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:26.135 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:26.134+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:26.251 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:26.250+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:27.128 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:27.127+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:27.299 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:27.298+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:28.118 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:28.117+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:28.254 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:28.253+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:29.081 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:29.080+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:29.214 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:29.213+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:30.089 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:30.088+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:30.173 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:30.172+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:31.065 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:31.063+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:31.143 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:31.142+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:32.072 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:32.072+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:32.157 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:32.156+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:33.055 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:33.054+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:33.124 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:33.123+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:34.025 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:34.023+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:34.124 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:34.122+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:34.980 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:34.978+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:35.126 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:35.124+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:35.939 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:35.937+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:36.170 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:36.169+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:36.941 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:36.939+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:37.210 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:37.208+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:37.915 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:37.913+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:38.233 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:38.231+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:38.923 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:38.921+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:39.205 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:39.203+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:39.942 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:39.938+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:40.182 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:40.180+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:40.941 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:40.940+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:41.199 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:41.197+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:41.892 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:41.891+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:42.227 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:42.225+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:42.906 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:42.905+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:43.274 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:43.273+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:43.891 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:43.891+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:44.318 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:44.317+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:44.936 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:44.935+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:45.347 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:45.346+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:45.887 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:45.886+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:46.366 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:46.366+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:46.859 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:46.859+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:47.332 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:47.331+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:47.907 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:47.906+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:48.323 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:48.322+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:48.919 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:48.918+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:49.298 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:49.294+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:49.888 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:49.882+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:50.276 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:50.275+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:50.883 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:50.882+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:51.283 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:51.282+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:51.880 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:51.880+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:52.326 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:52.325+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:52.930 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:52.929+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:53.359 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:53.358+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:53.922 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:53.922+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:54.336 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:54.335+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:54.949 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:54.948+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:55.319 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:55.318+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:55.922 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:55.921+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:56.298 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:56.297+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:56.890 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:56.889+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:57.251 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:57.250+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:57.857 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:57.856+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:58.237 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:58.236+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:58.837 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:58.836+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:07:59.243 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:07:59.242+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:07:59.865 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:07:59.864+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:00.215 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:00.214+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:00.893 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:00.892+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:01.225 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:01.224+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:01.861 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:01.860+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:02.261 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:02.260+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:02.899 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:02.898+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:03.243 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:03.242+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:03.870 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:03.869+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:04.229 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:04.228+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:04.891 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:04.890+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:05.203 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:05.202+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:05.927 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:05.926+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:06.175 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:06.174+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:06.910 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:06.910+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:07.179 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:07.179+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:07.906 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:07.906+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:08.196 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:08.196+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:08.859 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:08.858+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:09.196 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:09.196+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:09.857 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:09.856+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:10.230 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:10.230+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:10.865 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:10.864+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:11.230 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:11.229+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:11.835 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:11.834+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:12.209 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:12.208+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:12.804 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:12.803+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:13.163 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:13.162+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:13.817 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:13.816+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:14.130 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:14.129+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:14.861 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:14.860+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:15.104 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:15.103+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:15.820 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:15.820+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:16.123 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:16.122+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:16.800 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:16.798+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:17.157 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:17.155+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:17.764 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:17.763+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:18.118 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:18.117+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:18.810 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:18.808+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:19.076 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:19.074+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:19.784 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:19.782+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:20.122 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:20.120+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:20.755 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:20.753+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:21.120 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:21.118+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:21.755 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:21.753+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:22.074 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:22.072+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:22.721 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:22.719+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:23.077 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:23.076+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:23.687 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:23.685+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:24.120 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:24.118+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:24.684 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:24.682+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:25.073 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:25.072+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:25.690 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:25.689+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:26.113 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:26.112+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:26.647 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:26.646+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:27.087 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:27.087+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:27.663 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:27.663+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:28.044 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:28.044+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:28.658 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:28.657+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:28.996 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:28.995+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:29.679 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:29.678+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:29.998 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:29.998+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:30.634 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:30.633+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:31.045 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:31.044+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:31.631 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:31.630+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:32.057 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:32.056+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:32.672 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:32.671+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:33.098 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:33.097+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:33.630 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:33.630+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:34.076 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:34.075+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:34.611 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:34.610+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:35.050 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:35.050+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:35.641 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:35.640+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:36.077 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:36.077+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:36.639 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:36.638+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:37.058 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:37.058+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:37.616 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:37.615+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:38.085 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:38.084+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:38.611 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:38.610+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:39.049 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:39.048+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:39.628 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:39.627+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:40.030 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:40.029+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:40.648 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:40.647+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:40.981 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:40.981+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:41.678 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:41.677+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:41.972 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:41.972+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:42.700 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:42.699+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:42.954 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:42.954+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:43.746 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:43.745+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:43.928 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:43.927+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:44.757 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:44.756+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:44.931 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:44.930+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:45.786 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:45.786+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:45.961 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:45.960+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:46.760 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:46.759+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:46.955 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:46.954+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:47.786 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:47.786+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:47.949 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:47.948+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:48.768 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:48.768+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:48.937 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:48.936+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:49.774 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:49.773+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:49.913 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:49.912+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:50.787 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:50.786+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:50.903 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:50.902+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:51.753 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:51.752+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:51.883 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:51.882+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:52.756 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:52.755+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:52.847 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:52.847+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:53.777 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:53.777+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:53.822 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:53.822+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:54.742 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:54.742+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:54.773 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:54.772+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:55.763 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:55.762+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:55.768 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:55.768+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:56.726 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:56.725+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:56.801 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:56.800+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:57.760 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:57.760+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:57.821 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:57.820+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:58.713 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:58.712+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:58.831 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:58.830+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:08:59.691 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:08:59.689+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:08:59.806 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:08:59.805+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:00.738 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:00.737+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:00.845 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:00.844+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:01.758 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:01.757+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:01.838 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:01.837+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:02.730 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:02.729+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:02.829 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:02.827+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:03.727 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:03.726+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:03.849 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:03.848+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:04.719 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:04.717+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:04.859 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:04.857+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:05.738 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:05.737+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:05.888 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:05.887+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:06.711 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:06.709+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:06.917 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:06.915+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:07.702 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:07.701+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:07.902 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:07.901+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:08.711 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:08.710+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:08.920 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:08.919+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:09.663 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:09.662+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:09.952 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:09.951+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:10.673 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:10.673+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:10.940 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:10.939+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:11.706 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:11.705+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:11.967 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:11.966+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:12.687 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:12.686+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:13.000 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:12.999+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:13.645 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:13.645+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:13.951 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:13.951+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:14.613 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:14.612+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:14.938 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:14.937+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:15.583 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:15.583+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:15.928 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:15.928+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:16.583 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:16.582+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:16.922 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:16.921+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:17.600 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:17.599+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:17.874 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:17.874+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:18.631 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:18.631+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:18.854 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:18.854+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:19.618 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:19.618+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:19.856 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:19.856+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:20.600 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:20.599+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:20.846 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:20.843+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:21.580 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:21.579+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:21.881 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:21.881+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:22.572 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:22.571+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:22.917 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:22.916+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:23.592 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:23.591+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:23.892 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:23.891+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:24.546 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:24.545+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:24.847 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:24.846+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:25.547 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:25.546+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:25.804 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:25.803+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:26.570 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:26.569+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:26.816 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:26.816+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:27.572 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:27.571+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:27.805 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:27.804+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:28.574 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:28.574+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:28.802 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:28.802+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:29.563 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:29.562+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:29.816 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:29.815+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:30.596 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:30.596+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:30.823 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:30.822+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:31.629 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:31.629+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:31.801 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:31.800+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:32.584 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:32.583+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:32.845 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:32.845+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:33.558 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:33.558+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:33.818 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:33.817+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:34.516 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:34.515+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:34.847 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:34.847+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:35.481 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:35.480+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:35.853 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:35.852+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:36.485 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:36.484+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:36.854 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:36.853+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:37.524 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:37.523+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:37.896 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:37.895+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:38.496 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:38.496+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:38.865 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:38.865+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:39.529 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:39.529+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:39.841 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:39.841+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:40.521 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:40.521+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:40.855 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:40.854+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:41.489 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:41.489+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:41.827 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:41.826+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:42.449 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:42.447+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:42.861 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:42.860+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:43.459 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:43.458+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:43.880 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:43.878+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:44.414 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:44.412+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:44.893 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:44.892+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:45.455 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:45.454+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:45.885 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:45.884+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:46.446 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:46.444+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:46.895 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:46.894+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:47.397 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:47.395+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:47.917 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:47.915+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:48.436 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:48.429+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:48.933 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:48.931+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:49.439 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:49.437+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:49.932 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:49.930+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:50.410 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:50.409+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:50.913 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:50.911+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:51.375 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:51.373+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:51.865 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:51.864+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:52.359 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:52.359+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:52.821 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:52.820+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:53.399 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:53.397+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:53.835 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:53.835+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:54.385 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:54.385+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:54.791 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:54.790+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:55.415 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:55.415+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:55.780 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:55.779+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:56.413 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:56.412+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:56.822 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:56.821+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:57.439 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:57.439+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:57.801 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:57.800+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:58.488 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:58.487+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:58.806 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:58.805+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:09:59.447 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:09:59.446+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:09:59.763 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:09:59.763+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:00.407 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:00.407+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:00.789 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:00.788+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:01.430 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:01.430+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:01.839 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:01.839+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:02.393 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:02.393+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:02.885 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:02.885+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:03.389 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:03.388+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:03.851 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:03.850+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:04.373 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:04.373+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:04.851 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:04.851+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:05.419 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:05.419+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:05.821 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:05.821+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:06.424 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:06.423+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:06.841 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:06.840+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:07.439 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:07.438+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:07.824 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:07.824+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:08.426 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:08.426+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:08.813 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:08.812+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:09.459 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:09.458+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:09.773 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:09.772+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:10.465 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:10.464+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:10.794 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:10.794+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:11.495 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:11.494+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:11.843 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:11.842+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:12.499 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:12.498+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:12.865 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:12.864+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:13.543 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:13.543+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:13.893 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:13.893+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:14.582 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:14.581+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:14.929 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:14.928+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:15.540 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:15.540+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:15.939 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:15.938+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:16.561 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:16.561+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:16.968 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:16.967+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:17.523 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:17.522+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:18.008 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:18.007+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:18.507 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:18.507+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:19.012 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:19.011+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:19.544 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:19.543+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:19.986 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:19.986+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:20.554 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:20.553+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:20.969 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:20.968+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:21.587 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:21.586+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:21.980 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:21.979+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:22.556 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:22.556+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:22.934 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:22.934+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:23.519 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:23.519+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:23.962 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:23.961+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:24.522 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:24.521+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:24.973 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:24.972+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:25.496 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:25.494+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:25.956 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:25.954+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:26.491 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:26.489+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:26.964 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:26.962+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:27.474 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:27.473+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:27.972 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:27.970+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:28.494 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:28.492+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:28.961 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:28.959+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:29.525 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:29.524+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:29.914 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:29.913+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:30.497 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:30.496+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:30.952 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:30.951+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:31.512 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:31.511+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:31.956 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:31.954+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:32.561 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:32.560+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:32.935 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:32.934+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:33.543 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:33.542+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:33.924 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:33.922+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:34.569 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:34.569+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:34.958 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:34.957+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:35.564 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:35.563+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:35.982 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:35.981+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:36.575 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:36.574+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:36.943 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:36.943+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:37.547 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:37.546+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:37.989 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:37.989+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:38.562 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:38.561+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:39.000 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:39.000+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:39.572 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:39.571+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:39.977 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:39.977+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:40.601 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:40.601+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:40.985 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:40.985+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:41.563 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:41.563+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:42.024 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:42.023+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:42.613 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:42.613+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:43.016 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:43.016+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:43.565 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:43.565+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:44.053 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:44.052+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:44.587 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:44.586+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:45.025 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:45.025+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:45.634 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:45.633+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:46.023 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:46.023+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:46.607 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:46.607+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:47.023 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:47.023+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:47.625 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:47.624+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:48.043 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:48.042+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:48.667 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:48.667+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:49.000 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:48.999+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:49.700 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:49.700+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:49.987 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:49.986+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:50.669 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:50.669+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:50.986 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:50.986+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:51.706 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:51.705+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:52.000 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:51.999+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:52.713 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:52.713+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:52.979 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:52.979+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:53.756 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:53.755+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:53.985 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:53.985+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:54.765 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:54.764+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:54.975 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:54.974+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:55.773 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:55.772+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:55.983 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:55.982+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:56.811 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:56.810+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:56.935 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:56.935+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:57.853 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:57.853+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:57.893 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:57.893+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:58.882 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:58.882+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:58.925 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:58.924+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:10:59.846 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:10:59.846+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:10:59.909 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:10:59.908+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:00.873 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:00.872+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:00.918 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:00.915+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:01.899 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:01.899+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:01.904 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:01.904+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:02.872 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:02.872+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:02.885 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:02.883+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:03.823 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:03.823+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:03.892 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:03.892+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:04.837 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:04.837+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:04.941 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:04.940+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:05.808 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:05.808+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:05.975 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:05.975+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:06.846 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:06.845+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:07.022 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:07.022+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:07.889 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:07.888+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:07.999 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:07.998+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:08.932 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:08.930+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:09.006 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:09.004+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:09.927 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:09.925+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:10.010 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:10.008+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:10.942 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:10.940+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:11.004 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:11.002+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:11.920 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:11.918+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:11.996 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:11.995+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:12.931 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:12.929+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:12.979 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:12.977+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:13.920 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:13.919+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:13.985 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:13.984+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:14.937 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:14.936+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:15.027 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:15.026+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:15.944 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:15.943+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:16.023 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:16.022+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:16.954 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:16.953+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:17.028 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:17.028+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:17.960 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:17.959+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:18.073 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:18.072+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:18.959 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:18.959+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:19.114 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:19.114+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:19.946 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:19.946+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:20.164 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:20.164+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:20.948 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:20.948+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:21.167 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:21.166+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:21.905 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:21.904+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:22.163 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:22.162+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:22.956 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:22.955+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:23.208 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:23.208+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:23.932 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:23.932+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:24.215 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:24.215+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:24.962 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:24.961+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:25.265 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:25.264+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:25.974 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:25.973+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:26.246 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:26.243+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:26.690 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T16:11:26.690+0000 7fa2a9acd700 0 -- 172.21.15.123:0/1871504539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa28c036750 msgr2=0x7fa28c038b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T16:11:26.940 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:26.939+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:27.288 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:27.287+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:27.916 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:27.915+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:28.244 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:28.244+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:28.907 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:28.906+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:29.226 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:29.226+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:29.928 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:29.927+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:30.226 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:30.226+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:30.939 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:30.939+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:31.198 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:31.198+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:31.965 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:31.964+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:32.204 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:32.204+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:32.990 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:32.990+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:33.206 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:33.206+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:33.969 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:33.969+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:34.254 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:34.254+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:34.986 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:34.986+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:35.301 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:35.301+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:36.008 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:36.007+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:36.268 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:36.268+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:37.019 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:37.019+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:37.274 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:37.274+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:38.032 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:38.032+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:38.242 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:38.242+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:39.056 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:39.055+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:39.281 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:39.280+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:40.041 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:40.040+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:40.304 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:40.304+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:41.032 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:41.032+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:41.347 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:41.346+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:42.011 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:42.010+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:42.388 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:42.387+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:43.035 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:43.035+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:43.366 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:43.366+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:43.990 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:43.989+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:44.413 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:44.412+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:45.027 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:45.026+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:45.418 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:45.418+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:46.067 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:46.067+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:46.388 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:46.388+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:47.050 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:47.049+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:47.409 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:47.408+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:48.031 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:48.030+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:48.421 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:48.420+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:48.999 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:48.998+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:49.407 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:49.407+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:50.028 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:50.027+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:50.448 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:50.447+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:51.045 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:51.043+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:51.431 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:51.430+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:52.032 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:52.031+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:52.395 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:52.394+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:53.078 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:53.076+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:53.407 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:53.405+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:54.112 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:54.110+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:54.389 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:54.388+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:55.124 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:55.122+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:55.434 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:55.432+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:56.146 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:56.145+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:56.409 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:56.407+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:57.165 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:57.164+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:57.407 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:57.400+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:58.211 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:58.209+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:58.439 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:58.438+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:11:59.223 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:11:59.222+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:11:59.483 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:11:59.482+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:00.267 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:00.266+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:00.483 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:00.482+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:01.254 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:01.254+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:01.446 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:01.446+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:02.212 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:02.211+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:02.419 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:02.418+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:03.168 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:03.168+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:03.386 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:03.386+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:04.149 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:04.149+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:04.378 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:04.377+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:05.162 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:05.162+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:05.372 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:05.372+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:06.193 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:06.192+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:06.415 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:06.415+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:07.194 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:07.193+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:07.380 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:07.380+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:08.178 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:08.178+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:08.424 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:08.424+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:09.184 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:09.184+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:09.414 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:09.414+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:10.162 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:10.162+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:10.393 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:10.393+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:11.159 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:11.159+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:11.415 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:11.415+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:12.118 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:12.118+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:12.414 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:12.414+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:13.159 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:13.158+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:13.400 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:13.399+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:14.135 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:14.134+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:14.440 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:14.440+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:15.167 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:15.166+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:15.433 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:15.432+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:16.142 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:16.142+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:16.426 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:16.425+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:17.167 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:17.167+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:17.421 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:17.420+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:18.212 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:18.212+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:18.381 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:18.380+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:19.260 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:19.259+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:19.412 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:19.412+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:20.300 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:20.299+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:20.418 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:20.417+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:21.314 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:21.314+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:21.370 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:21.369+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:22.330 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:22.330+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:22.336 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:22.335+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:23.344 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:23.344+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:23.380 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:23.379+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:24.349 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:24.349+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:24.350 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:24.350+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:25.306 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:25.305+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:25.369 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:25.368+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:26.336 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:26.335+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:26.340 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:26.339+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:27.315 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:27.314+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:27.371 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:27.370+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:28.326 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:28.325+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:28.382 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:28.382+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:29.303 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:29.302+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:29.413 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:29.412+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:30.348 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:30.348+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:30.439 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:30.439+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:31.340 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:31.340+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:31.424 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:31.424+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:32.345 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:32.344+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:32.470 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:32.469+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:33.356 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:33.354+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:33.483 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:33.482+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:34.367 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:34.366+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:34.528 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:34.527+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:35.345 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:35.344+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:35.492 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:35.491+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:36.323 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:36.322+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:36.460 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:36.459+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:37.302 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:37.300+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:37.473 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:37.472+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:38.335 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:38.334+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:38.434 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:38.433+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:39.342 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:39.341+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:39.415 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:39.414+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:40.381 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:40.379+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:40.457 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:40.456+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:41.331 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:41.330+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:41.483 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:41.482+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:42.284 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:42.284+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:42.515 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:42.515+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:43.262 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:43.262+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:43.544 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:43.544+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:44.296 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:44.296+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:44.518 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:44.517+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:45.301 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:45.301+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:45.566 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:45.565+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:46.290 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:46.289+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:46.540 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:46.540+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:47.271 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:47.271+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:47.562 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:47.562+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:48.270 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:48.270+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:48.553 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:48.552+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:49.258 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:49.258+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:49.512 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:49.512+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:50.249 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:50.248+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:50.537 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:50.536+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:51.240 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:51.240+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:51.537 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:51.537+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:52.236 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:52.236+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:52.580 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:52.579+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:53.195 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:53.195+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:53.562 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:53.562+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:54.240 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:54.239+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:54.603 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:54.603+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:55.193 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:55.193+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:55.613 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:55.613+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:56.205 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:56.204+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:56.612 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:56.612+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:57.192 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:57.192+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:57.624 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:57.624+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:58.219 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:58.218+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:58.649 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:58.649+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:12:59.196 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:12:59.196+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:12:59.631 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:12:59.630+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:00.191 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:00.154+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:00.583 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:00.583+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:01.192 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:01.192+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:01.618 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:01.618+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:02.230 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:02.230+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:02.596 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:02.596+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:03.240 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:03.240+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:03.550 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:03.549+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:04.272 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:04.272+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:04.557 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:04.557+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:05.292 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:05.292+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:05.557 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:05.557+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:06.288 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:06.288+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:06.528 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:06.528+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:07.273 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:07.272+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:07.525 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:07.524+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:08.255 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:08.255+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:08.497 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:08.496+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:09.217 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:09.217+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:09.457 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:09.457+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:10.188 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:10.188+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:10.443 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:10.443+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:11.147 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:11.146+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:11.479 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:11.479+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:12.101 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:12.101+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:12.482 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:12.482+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:13.095 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:13.095+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:13.520 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:13.520+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:14.050 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:14.050+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:14.472 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:14.471+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:15.015 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:15.013+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:15.508 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:15.507+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:15.986 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:15.985+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:16.481 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:16.480+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:17.026 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:17.025+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:17.445 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:17.443+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:18.010 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:18.009+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:18.493 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:18.492+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:18.980 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:18.978+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:19.472 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:19.471+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:19.942 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:19.941+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:20.430 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:20.429+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:20.971 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:20.969+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:21.422 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:21.421+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:21.978 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:21.976+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:22.379 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:22.378+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:22.970 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:22.969+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:23.421 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:23.419+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:23.956 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:23.955+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:24.408 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:24.408+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:24.985 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:24.984+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:25.452 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:25.452+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:25.991 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:25.990+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:26.454 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:26.453+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:26.944 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:26.944+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:27.501 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:27.501+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:27.968 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:27.968+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:28.485 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:28.485+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:28.948 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:28.948+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:29.447 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:29.446+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:29.953 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:29.953+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:30.433 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:30.432+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:30.948 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:30.948+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:31.478 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:31.477+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:31.916 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:31.916+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:32.524 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:32.524+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:32.894 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:32.894+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:33.558 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:33.558+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:33.922 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:33.922+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:34.518 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:34.518+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:34.874 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:34.873+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:35.543 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:35.543+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:35.847 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:35.847+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:36.580 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:36.580+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:36.862 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:36.861+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:37.542 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:37.542+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:37.817 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:37.816+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:38.563 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:38.559+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:38.789 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:38.789+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:39.532 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:39.532+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:39.780 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:39.780+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:40.501 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:40.500+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:40.756 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:40.756+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:41.514 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:41.514+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:41.732 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:41.732+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:42.524 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:42.523+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:42.732 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:42.732+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:43.498 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:43.498+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:43.702 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:43.702+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:44.483 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:44.483+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:44.748 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:44.748+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:45.439 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:45.439+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:45.789 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:45.789+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:46.436 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:46.436+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:46.829 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:46.829+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:47.458 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:47.458+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:47.840 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:47.840+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:48.416 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:48.416+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:48.888 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:48.887+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:49.412 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:49.411+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:49.869 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:49.869+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:50.435 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:50.434+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:50.917 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:50.916+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:51.389 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:51.389+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:51.953 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:51.953+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:52.371 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:52.370+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:52.975 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:52.975+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:53.394 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:53.394+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:54.010 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:54.009+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:54.412 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:54.412+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:55.041 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:55.040+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:55.449 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:55.449+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:56.006 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:56.006+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:56.482 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:56.481+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:56.968 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:56.968+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:57.467 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:57.465+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:58.014 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:58.013+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:58.464 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:58.463+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:58.973 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:58.971+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:13:59.468 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:13:59.467+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:13:59.984 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:13:59.982+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:00.506 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:00.505+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:00.946 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:00.945+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:01.496 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:01.495+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:01.907 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:01.905+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:02.516 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:02.515+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:02.878 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:02.876+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:03.554 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:03.552+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:03.845 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:03.844+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:04.578 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:04.577+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:04.850 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:04.849+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:05.610 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:05.609+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:05.886 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:05.885+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:06.641 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:06.641+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:06.933 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:06.932+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:07.661 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:07.661+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:07.930 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:07.930+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:08.612 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:08.612+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:08.975 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:08.975+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:09.626 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:09.626+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:10.005 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:10.005+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:10.648 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:10.647+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:11.032 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:11.031+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:11.633 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:11.633+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:12.051 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:12.051+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:12.623 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:12.623+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:13.007 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:13.006+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:13.613 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:13.613+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:14.008 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:14.007+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:14.613 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:14.613+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:15.014 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:15.013+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:15.580 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:15.579+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:16.020 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:16.019+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:16.564 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:16.563+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:17.031 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:17.031+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:17.527 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:17.527+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:18.006 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:18.006+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:18.561 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:18.561+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:19.023 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:19.023+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:19.515 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:19.514+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:20.041 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:20.040+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:20.547 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:20.546+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:21.028 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:21.028+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:21.577 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:21.577+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:22.047 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:22.046+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:22.567 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:22.567+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:23.014 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:23.014+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:23.609 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:23.609+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:24.043 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:24.043+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:24.645 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:24.645+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:25.041 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:25.041+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:25.598 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:25.598+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:26.002 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:26.001+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:26.640 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:26.639+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:27.011 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:27.011+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:27.611 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:27.611+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:28.039 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:28.039+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:28.629 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:28.629+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:29.036 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:29.036+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:29.603 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:29.603+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:30.017 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:30.017+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:30.612 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:30.612+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:30.988 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:30.988+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:31.567 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:31.567+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:32.015 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:32.014+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:32.575 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:32.575+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:32.987 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:32.987+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:33.550 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:33.550+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:34.034 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:34.034+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:34.570 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:34.570+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:35.055 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:35.055+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:35.550 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:35.549+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:36.074 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:36.074+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:36.525 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:36.525+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:37.105 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:37.105+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:37.494 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:37.494+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:38.085 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:38.085+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:38.524 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:38.523+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:39.131 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:39.131+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:39.521 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:39.519+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:40.140 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:40.138+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:40.480 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:40.479+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:41.189 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:41.185+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:41.524 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:41.522+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:42.167 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:42.165+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:42.535 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:42.534+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:43.213 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:43.211+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:43.508 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:43.506+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:44.212 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:44.211+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:44.487 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:44.486+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:45.242 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:45.241+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:45.455 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:45.454+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:46.250 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:46.249+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:46.491 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:46.489+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:47.295 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:47.294+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:47.491 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:47.489+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:48.278 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:48.277+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:48.521 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:48.521+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:49.264 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:49.263+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:49.487 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:49.487+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:50.256 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:50.255+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:50.525 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:50.525+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:51.220 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:51.219+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:51.549 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:51.549+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:52.172 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:52.172+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:52.540 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:52.540+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:53.129 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:53.128+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:53.549 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:53.549+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:54.177 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:54.176+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:54.564 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:54.563+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:55.205 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:55.204+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:55.540 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:55.539+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:56.178 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:56.178+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:56.577 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:56.577+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:57.199 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:57.199+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:57.591 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:57.591+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:58.240 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:58.240+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:58.639 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:58.639+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:14:59.261 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:14:59.260+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:14:59.672 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:14:59.671+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:00.220 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:00.220+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:00.665 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:00.665+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:01.254 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:01.253+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:01.709 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:01.709+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:02.241 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:02.241+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:02.669 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:02.669+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:03.245 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:03.245+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:03.680 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:03.680+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:04.255 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:04.255+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:04.701 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:04.701+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:05.272 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:05.272+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:05.656 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:05.655+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:06.309 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:06.309+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:06.691 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:06.690+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:07.302 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:07.302+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:07.694 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:07.693+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:08.263 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:08.263+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:08.645 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:08.645+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:09.216 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:09.216+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:09.637 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:09.636+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:10.191 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:10.190+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:10.649 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:10.649+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:11.241 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:11.241+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:11.674 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:11.673+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:12.230 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:12.229+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:12.720 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:12.720+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:13.225 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:13.225+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:13.681 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:13.681+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:14.185 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:14.184+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:14.696 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:14.696+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:15.231 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:15.231+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:15.679 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:15.678+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:16.241 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:16.241+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:16.704 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:16.703+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:17.245 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:17.245+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:17.731 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:17.730+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:18.209 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:18.209+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:18.705 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:18.705+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:19.217 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:19.217+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:19.752 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:19.752+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:20.206 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:20.206+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:20.711 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:20.711+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:21.163 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:21.163+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:21.695 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:21.694+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:22.137 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:22.136+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:22.679 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:22.678+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:23.157 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:23.156+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:23.650 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:23.649+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:24.150 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:24.148+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:24.662 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:24.661+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:25.190 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:25.188+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:25.649 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:25.648+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:26.188 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:26.186+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:26.643 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:26.642+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:27.146 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:27.145+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:27.598 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:27.597+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:28.127 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:28.126+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:28.642 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:28.641+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:29.170 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:29.169+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:29.606 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:29.606+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:30.171 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:30.171+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:30.649 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:30.649+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:31.190 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:31.190+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:31.651 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:31.651+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:32.194 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:32.194+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:32.675 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:32.674+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:33.176 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:33.176+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:33.720 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:33.719+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:34.140 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:34.140+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:34.675 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:34.675+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:35.179 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:35.179+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:35.683 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:35.683+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:36.162 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:36.162+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:36.643 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:36.642+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:37.177 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:37.176+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:37.669 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:37.668+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:38.132 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:38.132+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:38.692 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:38.692+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:39.128 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:39.128+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:39.646 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:39.646+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:40.084 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:40.084+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:40.613 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:40.613+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:41.077 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:41.077+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:41.590 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:41.590+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:42.085 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:42.084+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:42.638 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:42.638+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:43.044 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:43.044+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:43.611 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:43.610+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:44.084 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:44.084+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:44.601 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:44.601+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:45.080 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:45.080+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:45.609 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:45.609+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:46.060 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:46.059+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:46.571 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:46.571+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:47.079 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:47.079+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:47.594 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:47.594+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:48.044 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:48.044+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:48.568 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:48.567+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:49.028 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:49.027+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:49.527 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:49.527+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:50.017 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:50.017+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:50.482 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:50.482+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:51.059 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:51.059+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:51.531 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:51.531+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:52.104 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:52.104+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:52.543 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:52.543+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:53.145 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:53.145+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:53.534 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:53.533+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:54.177 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:54.176+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:54.582 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:54.582+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:55.202 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:55.202+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:55.618 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:55.618+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:56.180 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:56.180+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:56.654 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:56.653+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:57.165 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:57.164+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:57.693 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:57.692+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:58.211 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:58.211+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:58.741 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:58.740+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:15:59.232 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:15:59.232+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:15:59.768 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:15:59.768+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:00.248 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:00.248+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:00.774 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:00.774+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:01.278 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:01.277+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:01.748 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:01.748+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:02.288 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:02.288+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:02.705 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:02.705+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:03.270 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:03.269+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:03.736 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:03.734+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:04.258 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:04.257+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:04.689 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:04.688+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:05.230 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:05.229+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:05.723 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:05.722+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:06.214 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:06.213+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:06.704 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:06.703+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:07.209 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:07.208+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:07.694 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:07.693+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:08.256 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:08.255+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:08.656 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:08.655+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:09.219 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:09.218+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:09.704 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:09.703+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:10.230 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:10.229+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:10.655 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:10.654+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:11.252 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:11.250+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:11.627 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:11.625+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:12.272 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:12.271+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:12.675 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:12.675+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:13.275 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:13.275+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:13.702 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:13.702+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:14.241 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:14.240+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:14.750 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:14.750+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:15.227 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:15.227+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:15.750 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:15.749+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:16.187 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:16.187+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:16.726 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:16.725+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:17.159 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:17.159+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:17.726 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:17.723+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:18.137 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:18.137+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:18.701 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:18.701+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:19.187 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:19.186+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:19.700 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:19.699+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:20.153 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:20.153+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:20.676 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:20.676+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:21.121 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:21.121+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:21.689 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:21.689+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:22.127 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:22.126+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:22.727 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:22.727+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:23.161 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:23.161+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:23.725 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:23.724+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:24.201 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:24.201+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:24.721 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:24.720+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:25.242 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:25.241+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:25.695 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:25.695+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:26.222 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:26.222+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:26.714 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:26.714+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:27.258 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:27.258+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:27.689 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:27.689+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:28.279 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:28.279+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:28.729 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:28.729+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:29.323 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:29.323+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:29.770 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:29.770+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:30.306 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:30.306+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:30.743 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:30.743+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:31.339 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:31.339+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:31.785 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:31.785+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:32.315 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:32.315+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:32.800 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:32.799+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:33.321 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:33.321+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:33.775 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:33.775+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:34.356 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:34.356+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:34.740 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:34.740+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:35.358 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:35.355+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:35.771 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:35.770+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:36.335 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:36.334+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:36.794 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:36.794+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:37.371 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:37.371+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:37.757 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:37.757+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:38.376 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:38.376+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:38.801 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:38.801+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:39.360 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:39.360+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:39.791 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:39.791+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:40.357 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:40.357+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:40.744 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:40.743+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:41.399 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:41.399+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:41.744 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:41.744+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:42.398 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:42.398+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:42.781 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:42.781+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:43.356 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:43.356+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:43.741 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:43.741+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:44.403 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:44.403+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:44.723 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:44.723+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:45.377 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:45.377+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:45.705 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:45.703+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:46.426 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:46.424+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:46.738 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:46.737+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:47.417 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:47.416+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:47.711 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:47.710+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:48.452 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:48.451+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:48.713 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:48.712+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:49.482 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:49.481+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:49.676 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:49.675+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:50.507 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:50.506+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:50.638 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:50.637+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:51.494 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:51.492+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:51.646 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:51.645+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:52.480 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:52.479+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:52.695 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:52.694+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:53.452 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:53.450+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:53.703 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:53.702+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:54.442 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:54.442+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:54.723 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:54.722+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:55.438 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:55.438+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:55.763 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:55.763+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:56.479 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:56.479+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:56.720 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:56.719+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:57.500 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:57.500+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:57.770 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:57.770+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:58.523 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:58.523+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:58.818 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:58.817+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:16:59.478 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:16:59.478+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:16:59.782 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:16:59.781+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:00.447 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:00.446+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:00.809 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:00.808+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:01.456 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:01.456+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:01.841 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:01.841+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:02.458 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:02.458+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:02.893 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:02.889+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:03.444 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:03.444+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:03.858 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:03.857+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:04.414 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:04.414+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:04.900 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:04.900+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:05.456 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:05.456+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:05.926 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:05.925+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:06.455 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:06.455+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:06.974 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:06.974+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:07.432 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:07.431+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:07.980 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:07.980+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:08.409 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:08.408+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:08.953 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:08.953+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:09.413 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:09.413+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:09.998 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:09.998+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:10.408 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:10.407+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:11.029 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:11.028+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:11.444 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:11.444+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:12.060 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:12.060+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:12.398 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:12.398+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:13.074 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:13.074+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:13.425 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:13.425+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:14.077 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:14.077+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:14.382 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:14.382+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:15.092 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:15.092+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:15.350 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:15.350+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:16.080 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:16.079+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:16.326 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:16.326+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:17.071 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:17.071+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:17.344 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:17.343+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:18.076 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:18.076+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:18.390 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:18.390+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:19.095 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:19.095+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:19.414 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:19.414+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:20.086 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:20.086+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:20.392 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:20.392+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:21.076 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:21.076+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:21.420 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:21.420+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:22.125 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:22.125+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:22.390 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:22.390+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:23.162 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:23.162+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:23.431 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:23.430+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:24.158 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:24.158+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:24.446 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:24.446+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:25.193 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:25.193+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:25.489 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:25.489+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:26.198 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:26.198+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:26.466 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:26.466+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:27.216 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:27.215+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:27.466 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:27.465+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:28.245 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:28.244+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:28.472 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:28.471+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:29.268 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:29.267+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:29.468 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:29.467+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:30.281 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:30.280+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:30.452 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:30.451+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:31.271 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:31.270+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:31.497 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:31.496+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:32.282 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:32.280+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:32.476 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:32.475+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:33.301 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:33.299+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:33.502 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:33.500+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:34.319 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:34.318+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:34.453 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:34.452+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:35.369 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:35.368+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:35.480 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:35.479+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:36.360 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:36.360+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:36.490 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:36.490+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:37.362 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:37.362+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:37.454 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:37.454+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:38.336 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:38.336+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:38.432 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:38.432+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:39.331 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:39.330+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:39.406 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:39.406+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:40.331 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:40.331+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:40.432 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:40.432+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:41.318 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:41.318+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:41.447 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:41.447+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:42.282 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:42.282+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:42.467 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:42.466+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:43.280 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:43.280+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:43.467 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:43.467+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:44.322 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:44.322+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:44.509 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:44.509+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:45.367 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:45.367+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:45.542 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:45.542+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:46.409 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:46.408+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:46.568 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:46.568+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:47.363 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:47.362+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:47.582 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:47.582+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:48.381 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:48.380+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:48.568 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:48.567+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:49.390 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:49.390+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:49.607 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:49.607+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:50.360 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:50.360+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:50.630 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:50.629+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:51.363 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:51.363+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:51.587 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:51.586+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:52.375 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:52.375+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:52.606 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:52.606+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:53.330 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:53.330+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:53.594 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:53.594+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:54.351 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:54.350+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:54.545 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:54.545+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:55.334 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:55.334+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:55.535 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:55.534+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:56.294 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:56.293+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:56.522 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:56.522+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:57.332 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:57.332+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:57.531 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:57.531+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:58.336 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:58.336+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:58.548 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:58.548+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:17:59.312 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:17:59.312+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:17:59.574 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:17:59.574+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:00.278 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:00.272+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:00.564 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:00.564+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:01.269 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:01.268+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:01.612 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:01.612+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:02.319 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:02.318+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:02.590 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:02.590+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:03.324 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:03.324+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:03.602 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:03.601+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:04.327 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:04.327+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:04.637 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:04.637+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:05.329 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:05.329+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:05.656 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:05.656+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:06.334 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:06.334+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:06.664 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:06.664+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:07.325 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:07.325+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:07.700 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:07.700+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:08.277 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:08.277+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:08.716 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:08.715+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:09.269 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:09.267+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:09.763 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:09.762+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:10.307 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:10.306+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:10.787 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:10.786+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:11.314 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:11.313+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:11.759 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:11.758+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:12.327 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:12.326+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:12.780 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:12.779+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:13.366 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:13.365+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:13.762 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:13.761+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:14.375 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:14.374+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:14.779 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:14.778+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:15.424 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:15.423+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:15.786 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:15.785+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:16.474 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:16.472+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:16.757 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:16.756+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:17.445 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:17.445+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:17.767 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:17.767+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:18.447 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:18.447+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:18.785 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:18.784+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:19.485 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:19.485+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:19.771 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:19.771+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:20.473 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:20.472+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:20.746 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:20.745+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:21.471 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:21.471+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:21.767 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:21.767+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:22.438 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:22.438+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:22.798 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:22.798+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:23.437 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:23.436+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:23.845 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:23.845+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:24.432 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:24.432+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:24.820 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:24.820+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:25.462 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:25.462+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:25.778 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:25.778+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:26.419 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:26.419+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:26.782 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:26.782+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:27.381 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:27.381+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:27.761 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:27.761+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:28.403 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:28.403+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:28.728 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:28.728+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:29.356 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:29.355+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:29.694 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:29.693+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:30.367 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:30.367+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:30.683 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:30.683+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:31.382 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:31.381+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:31.676 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:31.676+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:32.346 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:32.346+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:32.695 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:32.694+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:33.355 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:33.355+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:33.693 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:33.693+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:34.315 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:34.315+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:34.691 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:34.691+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:35.293 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:35.293+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:35.657 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:35.657+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:36.295 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:36.295+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:36.660 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:36.659+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:37.295 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:37.295+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:37.624 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:37.624+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:38.319 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:38.319+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:38.667 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:38.667+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:39.366 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:39.366+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:39.713 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:39.713+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:40.321 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:40.321+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:40.717 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:40.717+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:41.341 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:41.340+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:41.735 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:41.734+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:42.352 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:42.352+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:42.693 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:42.693+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:43.332 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:43.331+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:43.677 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:43.677+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:44.315 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:44.315+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:44.676 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:44.676+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:45.311 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:45.311+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:45.692 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:45.692+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:46.285 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:46.285+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:46.740 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:46.739+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:47.315 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:47.315+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:47.757 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:47.757+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:48.319 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:48.319+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:48.780 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:48.780+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:49.348 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:49.347+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:49.789 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:49.789+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:50.393 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:50.392+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:50.825 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:50.824+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:51.378 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:51.376+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:51.833 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:51.831+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:52.347 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:52.346+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:52.857 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:52.856+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:53.360 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:53.359+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:53.887 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:53.885+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:54.386 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:54.385+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:54.845 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:54.844+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:55.373 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:55.372+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:55.820 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:55.818+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:56.358 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:56.357+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:56.791 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:56.790+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:57.348 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:57.347+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:57.778 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:57.778+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:58.371 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:58.370+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:58.748 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:58.747+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:18:59.381 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:18:59.381+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:18:59.755 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:18:59.755+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:00.375 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:00.375+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:00.759 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:00.758+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:01.422 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:01.422+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:01.716 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:01.716+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:02.445 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:02.445+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:02.710 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:02.710+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:03.495 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:03.495+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:03.701 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:03.701+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:04.478 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:04.478+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:04.676 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:04.676+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:05.489 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:05.489+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:05.691 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:05.691+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:06.457 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:06.457+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:06.719 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:06.719+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:07.412 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:07.412+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:07.687 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:07.687+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:08.365 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:08.364+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:08.653 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:08.653+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:09.334 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:09.334+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:09.674 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:09.674+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:10.297 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:10.297+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:10.661 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:10.661+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:11.266 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:11.265+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:11.623 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:11.623+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:12.252 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:12.252+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:12.599 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:12.598+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:13.252 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:13.251+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:13.585 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:13.585+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:14.208 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:14.207+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:14.593 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:14.593+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:15.231 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:15.231+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:15.623 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:15.623+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:16.237 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:16.237+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:16.643 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:16.643+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:17.275 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:17.275+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:17.653 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:17.653+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:18.302 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:18.301+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:18.636 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:18.636+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:19.342 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:19.342+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:19.589 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:19.589+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:20.364 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:20.364+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:20.627 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:20.627+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:21.402 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:21.402+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:21.627 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:21.627+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:22.414 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:22.414+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:22.584 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:22.583+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:23.418 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:23.418+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:23.609 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:23.609+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:24.385 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:24.385+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:24.571 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:24.571+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:25.361 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:25.361+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:25.620 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:25.620+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:26.402 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:26.402+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:26.587 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:26.587+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:27.363 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:27.363+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:27.637 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:27.637+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:28.379 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:28.378+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:28.625 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:28.625+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:29.340 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:29.340+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:29.653 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:29.653+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:30.373 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:30.373+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:30.701 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:30.701+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:31.368 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:31.368+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:31.657 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:31.656+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:32.359 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:32.358+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:32.624 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:32.623+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:33.316 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:33.314+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:33.578 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:33.576+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:34.347 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:34.345+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:34.611 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:34.610+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:35.353 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:35.352+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:35.659 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:35.658+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:36.357 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:36.356+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:36.693 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:36.692+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:37.341 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:37.340+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:37.711 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:37.710+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:38.383 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:38.383+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:38.675 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:38.674+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:39.378 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:39.377+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:39.695 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:39.694+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:40.411 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:40.410+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:40.687 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:40.687+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:41.411 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:41.411+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:41.717 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:41.717+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:42.366 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:42.366+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:42.694 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:42.693+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:43.356 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:43.356+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:43.678 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:43.678+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:44.353 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:44.352+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:44.694 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:44.694+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:45.348 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:45.348+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:45.650 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:45.650+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:46.318 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:46.318+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:46.644 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:46.644+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:47.351 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:47.351+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:47.631 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:47.631+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:48.363 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:48.363+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:48.648 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:48.648+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:49.370 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:49.370+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:49.607 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:49.607+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:50.398 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:50.397+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:50.618 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:50.618+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:51.419 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:51.419+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:51.588 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:51.587+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:52.454 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:52.454+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:52.578 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:52.577+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:53.452 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:53.452+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:53.594 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:53.594+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:54.501 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:54.501+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:54.638 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:54.638+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:55.514 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:55.514+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:55.612 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:55.612+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:56.490 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:56.490+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:56.640 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:56.640+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:57.519 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:57.519+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:57.595 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:57.595+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:58.561 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:58.560+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:58.574 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:58.574+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:19:59.514 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:19:59.513+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:19:59.540 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:19:59.540+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:00.506 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:00.506+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:00.518 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:00.518+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:01.514 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:01.514+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:01.520 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:01.520+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:02.496 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:02.496+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:02.530 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:02.530+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:03.501 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:03.500+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:03.527 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:03.527+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:04.534 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:04.534+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:04.564 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:04.564+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:05.504 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:05.504+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:05.516 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:05.516+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:06.469 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:06.469+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:06.478 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:06.478+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:07.451 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:07.450+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:07.480 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:07.480+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:08.440 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:08.440+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:08.520 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:08.519+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:09.484 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:09.484+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:09.490 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:09.490+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:10.462 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:10.462+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:10.534 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:10.534+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:11.446 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:11.446+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:11.552 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:11.552+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:12.432 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:12.432+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:12.599 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:12.599+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:13.392 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:13.391+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:13.626 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:13.625+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:14.354 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:14.353+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:14.597 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:14.595+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:15.357 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:15.356+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:15.624 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:15.623+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:16.309 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:16.308+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:16.588 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:16.587+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:17.336 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:17.335+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:17.634 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:17.633+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:18.371 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:18.369+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:18.626 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:18.625+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:19.395 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:19.394+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:19.615 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:19.613+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:20.431 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:20.430+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:20.629 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:20.627+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:21.410 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:21.409+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:21.663 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:21.662+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:22.392 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:22.392+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:22.684 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:22.683+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:23.359 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:23.359+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:23.704 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:23.703+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:24.316 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:24.316+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:24.698 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:24.698+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:25.286 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:25.286+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:25.744 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:25.744+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:26.319 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:26.319+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:26.778 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:26.778+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:27.285 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:27.285+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:27.806 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:27.806+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:28.292 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:28.292+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:28.820 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:28.820+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:29.314 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:29.314+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:29.848 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:29.848+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:30.346 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:30.345+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:30.806 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:30.806+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:31.374 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:31.372+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:31.781 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:31.781+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:32.327 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:32.327+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:32.820 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:32.820+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:33.288 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:33.288+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:33.862 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:33.862+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:34.254 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:34.254+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:34.850 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:34.850+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:35.244 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:35.244+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:35.876 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:35.876+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:36.293 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:36.291+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:36.844 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:36.844+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:37.280 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:37.280+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:37.864 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:37.864+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:38.288 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:38.288+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:38.876 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:38.876+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:39.298 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:39.298+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:39.908 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:39.908+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:40.348 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:40.348+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:40.862 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:40.862+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:41.358 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:41.357+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:41.904 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:41.904+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:42.312 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:42.312+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:42.876 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:42.876+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:43.355 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:43.354+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:43.841 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:43.841+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:44.355 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:44.355+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:44.800 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:44.800+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:45.314 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:45.314+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:45.780 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:45.780+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:46.339 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:46.339+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:46.731 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:46.731+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:47.374 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:47.374+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:47.763 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:47.763+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:48.408 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:48.408+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:48.732 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:48.732+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:49.447 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:49.447+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:49.695 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:49.695+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:50.467 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:50.467+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:50.661 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:50.661+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:51.429 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:51.429+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:51.667 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:51.667+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:52.382 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:52.382+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:52.683 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:52.683+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:53.382 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:53.382+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:53.668 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:53.668+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:54.349 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:54.349+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:54.685 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:54.685+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:55.396 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:55.395+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:55.710 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:55.709+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:56.438 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:56.437+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:56.681 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:56.679+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:57.402 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:57.401+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:57.666 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:57.664+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:58.373 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:58.371+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:58.635 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:58.634+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:20:59.382 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:20:59.380+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:20:59.626 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:20:59.625+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:00.357 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:00.356+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:00.672 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:00.670+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:01.389 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:01.387+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:01.672 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:01.670+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:02.363 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:02.362+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:02.677 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:02.676+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:03.361 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:03.360+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:03.690 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:03.689+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:04.358 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:04.357+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:04.706 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:04.706+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:05.354 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:05.354+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:05.703 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:05.703+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:06.362 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:06.362+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:06.702 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:06.701+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:07.403 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:07.403+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:07.699 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:07.699+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:08.363 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:08.362+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:08.685 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:08.685+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:09.375 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:09.375+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:09.675 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:09.675+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:10.376 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:10.376+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:10.681 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:10.681+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:11.357 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:11.357+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:11.666 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:11.666+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:12.315 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:12.315+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:12.695 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:12.695+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:13.320 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:13.319+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:13.673 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:13.673+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:14.325 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:14.325+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:14.671 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:14.671+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:15.357 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:15.357+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:15.666 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:15.666+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:16.355 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:16.355+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:16.709 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:16.709+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:17.322 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:17.322+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:17.736 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:17.736+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:18.291 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:18.291+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:18.763 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:18.763+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:19.300 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:19.300+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:19.730 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:19.730+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:20.306 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:20.306+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:20.726 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:20.726+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:21.290 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:21.290+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:21.745 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:21.745+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:22.267 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:22.267+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:22.771 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:22.771+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:23.316 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:23.316+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:23.822 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:23.822+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:24.345 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:24.345+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:24.845 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:24.845+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:25.322 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:25.322+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:25.852 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:25.852+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:26.305 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:26.305+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:26.900 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:26.900+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:27.340 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:27.340+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:27.910 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:27.910+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:28.341 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:28.341+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:28.885 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:28.884+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:29.328 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:29.327+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:29.925 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:29.925+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:30.322 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:30.322+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:30.901 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:30.901+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:31.274 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:31.274+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:31.868 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:31.868+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:32.281 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:32.281+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:32.850 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:32.849+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:33.297 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:33.297+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:33.884 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:33.884+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:34.346 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:34.346+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:34.848 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:34.847+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:35.393 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:35.393+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:35.862 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:35.862+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:36.439 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:36.439+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:36.863 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:36.863+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:37.451 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:37.450+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:37.867 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:37.866+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:38.416 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:38.415+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:38.892 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:38.890+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:39.453 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:39.452+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:39.881 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:39.880+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:40.413 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:40.412+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:40.894 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:40.893+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:41.441 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:41.440+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:41.877 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:41.876+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:42.437 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:42.436+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:42.903 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:42.902+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:43.458 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:43.457+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:43.939 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:43.938+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:44.486 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:44.486+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:44.923 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:44.922+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:45.449 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:45.448+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:45.876 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:45.875+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:46.478 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:46.478+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:46.853 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:46.853+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:47.513 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:47.513+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:47.812 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:47.812+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:48.545 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:48.544+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:48.838 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:48.838+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:49.591 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:49.591+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:49.843 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:49.843+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:50.625 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:50.625+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:50.821 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:50.821+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:51.583 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:51.583+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:51.830 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:51.830+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:52.578 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:52.578+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:52.822 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:52.822+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:53.607 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:53.607+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:53.816 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:53.816+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:54.609 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:54.609+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:54.824 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:54.824+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:55.596 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:55.596+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:55.807 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:55.807+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:56.592 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:56.592+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:56.790 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:56.790+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:57.585 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:57.585+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:57.802 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:57.802+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:58.555 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:58.555+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:58.756 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:58.756+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:21:59.544 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:21:59.543+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:21:59.714 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:21:59.714+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:00.518 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:00.518+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:00.707 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:00.707+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:01.547 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:01.547+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:01.707 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:01.707+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:02.504 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:02.504+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:02.686 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:02.686+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:03.461 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:03.461+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:03.716 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:03.716+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:04.450 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:04.450+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:04.707 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:04.707+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:05.427 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:05.427+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:05.691 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:05.691+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:06.410 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:06.410+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:06.709 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:06.709+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:07.389 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:07.389+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:07.756 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:07.756+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:08.423 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:08.423+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:08.761 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:08.760+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:09.436 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:09.436+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:09.791 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:09.791+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:10.411 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:10.411+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:10.815 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:10.814+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:11.392 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:11.392+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:11.787 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:11.787+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:12.389 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:12.389+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:12.787 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:12.787+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:13.352 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:13.352+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:13.808 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:13.808+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:14.347 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:14.347+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:14.789 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:14.788+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:15.298 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:15.298+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:15.771 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:15.771+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:16.307 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:16.306+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:16.723 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:16.723+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:17.319 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:17.319+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:17.738 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:17.736+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:18.323 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:18.323+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:18.725 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:18.725+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:19.373 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:19.372+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:19.690 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:19.688+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:20.337 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:20.335+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:20.666 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:20.665+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:21.341 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:21.340+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:21.673 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:21.672+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:22.358 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:22.357+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:22.626 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:22.625+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:23.395 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:23.394+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:23.658 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:23.657+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:24.406 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:24.405+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:24.650 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:24.649+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:25.452 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:25.451+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:25.669 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:25.668+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:26.461 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:26.460+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:26.657 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:26.656+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:27.472 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:27.471+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:27.703 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:27.702+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:28.471 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:28.471+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:28.683 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:28.683+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:29.461 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:29.461+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:29.645 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:29.645+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:30.465 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:30.465+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:30.664 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:30.664+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:31.515 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:31.515+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:31.689 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:31.689+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:32.531 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:32.531+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:32.682 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:32.682+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:33.542 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:33.541+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:33.661 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:33.661+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:34.499 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:34.499+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:34.648 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:34.648+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:35.511 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:35.510+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:35.643 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:35.643+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:36.538 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:36.537+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:36.595 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:36.595+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:37.554 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:37.554+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:37.585 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:37.584+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:38.591 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:38.591+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:38.594 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:38.594+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:39.613 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:39.613+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:39.618 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:39.618+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:40.597 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:40.596+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:40.603 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:40.603+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:41.573 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:41.573+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:41.579 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:41.579+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:42.605 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:42.604+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:42.628 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:42.628+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:43.635 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:43.635+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:43.649 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:43.649+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:44.601 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:44.601+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:44.652 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:44.652+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:45.625 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:45.624+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:45.703 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:45.703+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:46.661 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:46.661+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:46.665 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:46.665+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:47.619 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:47.619+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:47.666 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:47.662+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:48.617 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:48.617+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:48.641 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:48.641+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:49.655 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:49.655+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:49.686 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:49.685+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:50.686 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:50.686+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:50.717 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:50.717+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:51.700 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:51.700+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:51.707 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:51.707+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:52.720 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:52.720+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:52.739 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:52.739+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:53.716 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:53.716+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:53.781 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:53.781+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:54.684 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:54.684+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:54.777 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:54.777+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:55.723 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:55.723+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:55.758 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:55.758+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:56.725 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:56.725+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:56.763 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:56.763+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:57.715 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:57.715+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:57.780 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:57.780+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:58.749 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:58.748+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:58.769 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:58.769+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:22:59.712 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:22:59.712+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:22:59.749 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:22:59.749+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:00.720 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:00.720+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:00.743 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:00.743+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:01.722 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:01.720+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:01.754 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:01.753+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:02.739 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:02.737+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:02.766 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:02.764+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:03.737 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:03.736+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:03.756 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:03.755+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:04.742 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:04.741+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:04.790 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:04.789+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:05.711 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:05.710+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:05.789 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:05.788+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:06.684 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:06.683+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:06.819 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:06.818+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:07.688 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:07.687+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:07.839 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:07.838+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:08.728 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:08.727+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:08.862 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:08.860+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:09.679 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:09.678+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:09.888 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:09.888+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:10.675 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:10.675+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:10.870 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:10.870+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:11.721 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:11.720+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:11.845 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:11.843+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:12.698 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:12.697+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:12.797 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:12.796+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:13.652 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:13.651+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:13.807 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:13.807+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:14.696 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:14.696+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:14.785 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:14.785+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:15.714 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:15.714+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:15.831 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:15.831+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:16.760 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:16.760+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:16.797 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:16.797+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:17.808 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:17.808+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:17.826 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:17.826+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:18.761 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:18.760+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:18.874 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:18.874+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:19.786 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:19.786+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:19.888 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:19.888+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:20.814 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:20.814+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:20.891 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:20.891+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:21.773 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:21.773+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:21.888 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:21.888+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:22.730 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:22.730+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:22.879 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:22.879+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:23.767 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:23.767+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:23.907 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:23.907+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:24.794 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:24.794+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:24.885 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:24.885+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:25.754 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:25.754+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:25.929 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:25.929+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:26.759 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:26.759+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:26.955 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:26.955+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:27.732 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:27.731+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:27.962 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:27.962+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:28.731 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:28.731+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:28.985 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:28.985+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:29.713 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:29.712+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:30.029 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:30.029+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:30.755 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:30.755+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:31.059 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:31.059+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:31.778 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:31.778+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:32.072 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:32.072+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:32.750 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:32.750+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:33.059 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:33.059+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:33.722 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:33.722+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:34.039 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:34.038+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:34.724 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:34.723+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:35.015 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:35.015+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:35.683 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:35.683+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:35.979 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:35.979+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:36.681 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:36.681+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:36.937 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:36.937+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:37.666 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:37.666+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:37.970 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:37.970+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:38.665 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:38.665+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:38.992 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:38.992+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:39.637 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:39.637+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:39.983 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:39.983+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:40.642 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:40.642+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:40.980 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:40.980+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:41.690 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:41.690+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:41.970 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:41.970+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:42.719 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:42.718+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:42.926 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:42.925+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:43.675 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:43.674+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:43.950 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:43.949+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:44.659 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:44.658+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:44.951 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:44.950+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:45.691 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:45.690+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:45.957 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:45.956+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:46.714 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:46.712+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:46.969 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:46.968+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:47.691 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:47.690+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:47.923 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:47.922+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:48.723 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:48.722+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:48.936 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:48.935+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:49.769 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:49.767+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:49.922 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:49.921+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:50.805 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:50.804+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:50.932 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:50.932+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:51.849 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:51.849+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:51.978 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:51.978+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:52.885 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:52.885+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:52.952 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:52.952+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:53.891 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:53.890+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:53.929 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:53.929+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:54.900 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:54.900+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:54.909 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:54.909+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:55.937 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:55.937+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:55.944 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:55.944+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:56.894 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:56.894+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:56.992 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:56.991+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:57.849 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:57.849+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:57.952 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:57.952+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:58.853 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:58.853+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:58.909 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:58.909+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:23:59.872 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:23:59.871+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:23:59.935 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:23:59.935+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:00.907 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:00.907+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:00.931 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:00.931+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:01.901 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:01.901+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:01.908 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:01.908+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:02.892 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:02.892+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:02.901 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:02.901+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:03.891 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:03.891+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:03.932 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:03.932+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:04.901 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:04.901+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:04.901 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:04.901+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:05.893 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:05.893+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:05.922 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:05.922+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:06.943 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:06.943+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:06.955 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:06.955+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:07.921 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:07.921+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:07.927 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:07.927+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:08.878 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:08.878+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:08.891 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:08.891+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:09.881 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:09.881+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:09.900 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:09.899+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:10.890 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:10.890+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:10.929 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:10.928+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:11.877 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:11.877+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:11.898 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:11.897+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:12.845 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:12.844+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:12.895 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:12.895+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:13.815 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:13.814+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:13.923 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:13.923+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:14.822 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:14.821+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:14.918 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:14.918+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:15.794 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:15.793+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:15.901 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:15.901+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:16.792 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:16.792+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:16.887 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:16.887+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:17.803 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:17.803+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:17.857 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:17.857+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:18.797 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:18.797+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:18.819 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:18.819+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:19.839 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:19.839+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:19.841 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:19.841+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:20.830 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:20.830+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:20.850 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:20.849+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:21.823 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:21.823+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:21.852 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:21.852+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:22.821 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:22.821+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:22.863 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:22.863+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:23.783 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:23.783+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:23.888 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:23.887+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:24.803 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:24.802+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:24.923 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:24.922+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:25.837 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:25.836+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:25.875 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:25.874+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:26.839 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:26.838+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:26.863 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:26.862+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:27.800 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:27.799+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:27.843 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:27.842+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:28.794 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:28.793+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:28.802 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:28.801+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:29.757 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:29.755+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:29.775 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:29.774+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:30.766 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:30.765+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:30.803 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:30.802+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:31.770 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:31.769+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:31.817 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:31.816+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:32.776 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:32.776+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:32.815 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:32.814+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:33.786 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:33.786+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:33.832 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:33.832+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:34.774 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:34.774+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:34.838 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:34.838+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:35.745 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:35.744+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:35.806 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:35.806+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:36.727 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:36.727+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:36.773 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:36.773+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:37.717 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:37.717+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:37.823 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:37.823+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:38.741 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:38.741+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:38.817 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:38.817+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:39.715 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:39.714+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:39.798 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:39.798+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:40.722 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:40.722+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:40.788 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:40.788+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:41.713 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:41.713+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:41.839 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:41.838+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:42.687 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:42.687+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:42.837 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:42.836+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:43.718 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:43.718+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:43.850 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:43.850+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:44.696 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:44.695+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:44.889 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:44.889+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:45.688 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:45.688+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:45.906 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:45.906+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:46.692 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:46.692+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:46.871 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:46.871+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:47.687 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:47.687+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:47.845 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:47.845+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:48.696 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:48.696+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:48.887 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:48.887+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:49.725 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:49.725+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:49.888 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:49.888+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:50.755 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:50.755+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:50.850 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:50.850+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:51.750 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:51.750+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:51.884 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:51.883+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:52.702 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:52.702+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:52.921 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:52.919+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:53.753 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:53.753+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:53.930 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:53.930+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:54.729 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:54.729+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:54.892 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:54.892+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:55.734 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:55.734+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:55.942 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:55.942+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:56.758 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:56.758+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:56.967 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:56.967+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:57.711 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:57.711+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:58.013 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:58.013+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:58.715 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:58.715+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:24:59.044 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:24:59.044+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:24:59.714 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:24:59.714+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:00.085 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:00.085+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:00.723 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:00.723+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:01.089 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:01.089+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:01.733 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:01.733+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:02.096 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:02.096+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:02.695 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:02.695+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:03.124 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:03.124+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:03.673 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:03.673+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:04.095 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:04.095+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:04.710 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:04.710+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:05.127 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:05.127+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:05.732 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:05.732+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:06.126 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:06.125+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:06.777 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:06.776+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:07.083 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:07.082+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:07.821 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:07.820+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:08.071 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:08.070+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:08.846 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:08.844+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:09.108 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:09.107+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:09.823 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:09.822+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:10.100 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:10.098+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:10.808 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:10.807+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:11.060 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:11.059+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:11.790 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:11.788+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:12.107 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:12.106+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:12.756 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:12.755+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:13.072 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:13.071+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:13.724 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:13.723+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:14.087 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:14.086+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:14.746 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:14.744+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:15.070 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:15.069+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:15.707 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:15.707+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:16.106 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:16.106+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:16.664 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:16.664+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:17.062 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:17.062+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:17.649 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:17.649+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:18.091 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:18.091+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:18.601 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:18.601+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:19.055 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:19.055+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:19.621 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:19.621+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:20.052 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:20.052+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:20.587 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:20.587+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:21.015 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:21.015+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:21.608 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:21.608+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:22.002 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:22.002+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:22.612 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:22.612+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:22.965 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:22.965+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:23.641 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:23.641+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:24.012 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:24.012+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:24.646 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:24.646+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:24.990 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:24.990+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:25.616 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:25.616+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:26.013 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:26.013+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:26.594 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:26.594+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:27.020 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:27.020+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:27.595 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:27.595+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:27.976 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:27.976+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:28.640 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:28.640+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:28.971 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:28.971+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:29.667 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:29.667+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:29.963 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:29.963+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:30.633 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:30.633+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:30.996 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:30.995+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:31.617 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:31.617+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:32.035 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:32.035+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:32.660 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:32.660+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:33.038 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:33.038+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:33.662 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:33.662+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:33.996 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:33.995+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:34.708 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:34.707+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:34.998 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:34.998+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:35.683 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:35.683+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:36.011 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:36.011+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:36.643 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:36.643+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:37.032 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:37.031+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:37.679 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:37.679+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:38.022 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:38.022+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:38.630 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:38.630+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:39.048 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:39.048+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:39.637 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:39.637+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:40.008 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:40.008+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:40.597 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:40.597+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:41.000 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:41.000+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:41.579 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:41.579+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:41.996 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:41.996+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:42.627 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:42.627+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:43.012 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:43.012+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:43.648 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:43.648+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:44.050 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:44.050+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:44.639 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:44.639+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:45.087 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:45.087+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:45.629 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:45.629+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:46.048 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:46.048+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:46.611 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:46.611+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:47.026 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:47.026+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:47.579 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:47.578+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:48.001 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:48.001+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:48.592 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:48.591+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:49.004 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:49.003+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:49.625 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:49.624+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:49.978 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:49.977+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:50.621 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:50.620+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:51.023 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:51.022+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:51.586 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:51.585+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:52.068 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:52.067+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:52.546 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:52.545+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:53.048 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:53.047+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:53.545 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:53.544+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:54.037 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:54.036+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:54.595 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:54.594+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:55.083 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:55.083+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:55.588 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:55.588+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:56.096 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:56.095+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:56.541 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:56.540+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:57.096 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:57.095+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:57.504 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:57.504+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:58.058 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:58.058+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:58.511 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:58.511+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:25:59.086 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:25:59.086+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:25:59.555 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:25:59.555+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:00.056 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:00.056+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:00.516 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:00.516+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:01.022 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:01.022+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:01.510 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:01.510+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:02.047 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:02.047+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:02.503 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:02.503+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:03.064 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:03.064+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:03.494 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:03.494+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:04.020 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:04.019+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:04.519 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:04.519+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:05.016 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:05.016+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:05.524 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:05.524+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:06.065 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:06.065+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:06.533 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:06.533+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:07.044 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:07.044+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:07.534 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:07.534+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:08.010 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:08.010+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:08.501 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:08.501+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:09.059 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:09.059+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:09.453 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:09.453+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:10.014 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:10.014+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:10.485 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:10.485+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:10.992 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:10.991+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:11.512 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:11.512+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:11.989 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:11.989+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:12.558 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:12.558+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:12.946 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:12.946+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:13.536 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:13.536+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:13.908 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:13.908+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:14.502 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:14.502+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:14.953 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:14.953+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:15.477 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:15.477+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:15.975 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:15.975+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:16.510 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:16.510+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:16.938 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:16.938+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:17.481 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:17.481+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:17.927 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:17.927+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:18.513 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:18.513+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:18.926 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:18.926+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:19.472 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:19.471+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:19.927 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:19.927+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:20.505 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:20.505+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:20.954 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:20.954+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:21.489 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:21.489+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:21.997 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:21.997+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:22.508 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:22.508+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:22.985 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:22.985+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:23.489 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:23.489+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:23.994 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:23.994+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:24.493 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:24.493+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:25.043 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:25.043+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:25.515 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:25.515+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:25.998 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:25.998+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:26.533 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:26.533+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:26.997 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:26.997+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:27.583 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:27.583+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:28.005 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:28.005+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:28.572 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:28.572+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:28.979 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:28.979+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:29.598 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:29.598+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:30.000 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:30.000+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:30.560 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:30.560+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:30.955 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:30.955+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:31.518 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:31.517+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:32.001 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:32.000+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:32.534 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:32.533+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:32.963 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:32.962+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:33.515 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:33.514+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:33.936 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:33.935+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:34.485 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:34.484+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:34.930 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:34.929+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:35.474 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:35.473+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:35.920 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:35.919+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:36.461 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:36.460+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:36.877 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:36.876+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:37.434 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:37.433+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:37.874 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:37.873+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:38.400 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:38.400+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:38.903 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:38.901+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:39.384 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:39.383+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:39.879 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:39.878+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:40.342 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:40.342+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:40.853 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:40.853+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:41.294 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:41.294+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:41.847 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:41.847+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:42.304 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:42.304+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:42.816 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:42.816+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:43.257 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:43.257+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:43.850 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:43.850+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:44.297 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:44.297+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:44.817 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:44.817+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:45.288 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:45.288+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:45.807 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:45.807+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:46.296 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:46.296+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:46.806 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:46.806+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:47.303 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:47.303+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:47.784 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:47.784+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:48.338 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:48.338+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:48.821 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:48.821+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:49.352 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:49.352+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:49.832 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:49.832+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:50.325 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:50.325+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:50.821 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:50.821+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:51.301 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:51.301+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:51.795 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:51.795+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:52.333 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:52.333+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:52.799 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:52.799+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:53.338 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:53.338+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:53.836 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:53.836+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:54.291 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:54.291+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:54.833 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:54.833+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:55.290 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:55.290+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:55.841 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:55.841+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:56.322 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:56.321+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:56.898 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:56.884+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:57.322 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:57.322+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:57.843 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:57.843+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:58.330 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:58.330+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:58.857 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:58.857+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:26:59.348 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:26:59.348+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:26:59.891 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:26:59.891+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:00.316 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:00.316+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:00.873 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:00.873+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:01.294 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:01.294+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:01.855 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:01.855+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:02.283 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:02.283+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:02.846 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:02.845+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:03.297 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:03.297+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:03.855 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:03.855+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:04.262 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:04.262+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:04.852 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:04.852+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:05.236 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:05.236+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:05.862 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:05.862+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:06.235 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:06.235+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:06.899 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:06.899+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:07.228 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:07.228+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:07.879 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:07.879+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:08.278 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:08.278+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:08.926 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:08.926+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:09.260 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:09.260+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:09.938 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:09.938+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:10.270 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:10.270+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:10.979 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:10.979+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:11.315 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:11.315+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:11.983 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:11.983+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:12.290 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:12.290+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:12.955 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:12.955+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:13.254 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:13.254+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:13.941 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:13.940+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:14.237 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:14.236+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:14.901 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:14.900+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:15.253 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:15.252+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:15.945 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:15.944+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:16.278 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:16.277+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:16.980 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:16.979+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:17.254 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:17.252+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:17.971 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:17.969+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:18.269 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:18.268+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:18.955 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:18.954+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:19.263 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:19.262+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:19.982 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:19.981+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:20.298 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:20.297+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:20.996 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:20.995+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:21.260 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:21.259+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:22.040 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:22.039+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:22.246 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:22.245+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:23.084 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:23.084+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:23.282 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:23.282+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:24.119 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:24.119+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:24.279 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:24.279+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:25.117 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:25.117+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:25.288 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:25.288+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:26.148 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:26.148+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:26.290 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:26.290+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:27.161 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:27.161+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:27.251 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:27.251+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:28.191 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:28.191+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:28.271 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:28.271+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:29.201 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:29.201+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:29.257 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:29.257+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:30.163 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:30.163+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:30.209 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:30.209+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:31.208 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:31.208+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:31.209 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:31.209+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:32.195 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:32.195+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:32.227 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:32.227+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:33.187 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:33.187+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:33.250 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:33.250+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:34.234 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:34.234+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:34.261 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:34.261+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:35.233 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:35.233+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:35.239 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:35.239+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:36.193 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:36.193+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:36.241 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:36.241+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:37.233 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:37.233+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:37.238 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:37.238+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:38.229 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:38.229+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:38.279 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:38.279+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:39.247 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:39.247+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:39.256 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:39.256+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:40.282 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:40.282+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:40.305 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:40.305+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:41.289 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:41.289+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:41.291 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:41.291+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:42.264 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:42.264+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:42.316 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:42.316+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:43.253 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:43.253+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:43.277 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:43.277+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:44.252 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:44.251+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:44.256 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:44.257+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:45.288 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:45.287+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:45.303 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:45.303+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:46.259 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:46.259+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:46.261 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:46.262+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:47.284 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:47.284+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:47.309 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:47.306+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:48.243 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:48.243+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:48.320 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:48.320+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:49.198 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:49.198+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:49.332 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:49.332+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:50.155 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:50.155+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:50.287 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:50.287+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:51.199 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:51.199+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:51.325 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:51.325+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:52.235 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:52.235+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:52.320 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:52.320+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:53.231 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:53.231+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:53.324 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:53.324+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:54.251 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:54.251+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:54.301 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:54.301+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:55.259 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:55.259+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:55.266 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:55.266+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:56.236 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:56.235+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:56.307 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:56.306+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:57.280 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:57.279+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:57.357 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:57.355+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:58.288 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:58.287+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:58.366 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:58.365+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:27:59.298 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:27:59.297+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:27:59.390 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:27:59.389+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:00.331 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:00.329+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:00.397 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:00.396+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:01.352 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:01.351+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:01.428 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:01.426+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:02.357 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:02.356+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:02.466 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:02.466+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:03.357 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:03.356+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:03.514 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:03.513+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:04.342 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:04.341+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:04.500 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:04.499+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:05.357 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:05.357+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:05.550 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:05.550+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:06.349 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:06.349+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:06.542 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:06.542+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:07.363 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:07.363+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:07.548 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:07.548+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:08.329 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:08.329+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:08.559 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:08.559+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:09.321 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:09.321+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:09.604 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:09.604+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:10.311 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:10.311+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:10.594 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:10.594+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:11.334 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:11.334+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:11.628 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:11.627+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:12.303 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:12.303+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:12.603 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:12.603+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:13.277 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:13.277+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:13.649 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:13.649+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:14.238 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:14.238+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:14.610 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:14.610+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:15.273 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:15.273+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:15.569 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:15.569+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:16.321 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:16.321+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:16.591 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:16.591+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:17.277 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:17.277+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:17.606 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:17.606+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:18.259 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:18.259+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:18.609 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:18.608+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:19.303 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:19.303+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:19.654 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:19.654+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:20.256 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:20.256+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:20.618 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:20.618+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:21.297 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:21.297+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:21.611 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:21.611+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:22.295 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:22.295+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:22.594 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:22.594+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:23.290 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:23.290+0000 7efce025d700 -1 osd.0 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:23.643 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:23.644+0000 7f29d5b73700 -1 osd.1 153 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:24.267 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:24.267+0000 7efce025d700 -1 osd.0 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:24.616 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:24.616+0000 7f29d5b73700 -1 osd.1 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:25.286 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:25.286+0000 7efce025d700 -1 osd.0 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:25.654 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:25.654+0000 7f29d5b73700 -1 osd.1 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:26.321 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:26.321+0000 7efce025d700 -1 osd.0 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:26.661 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:26.661+0000 7f29d5b73700 -1 osd.1 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:27.358 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:27.358+0000 7efce025d700 -1 osd.0 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:27.668 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:27.668+0000 7f29d5b73700 -1 osd.1 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:28.359 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:28.359+0000 7efce025d700 -1 osd.0 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:28.704 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:28.704+0000 7f29d5b73700 -1 osd.1 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:29.386 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:29.386+0000 7efce025d700 -1 osd.0 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:29.680 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:29.680+0000 7f29d5b73700 -1 osd.1 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:30.385 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:30.385+0000 7efce025d700 -1 osd.0 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:30.718 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:30.718+0000 7f29d5b73700 -1 osd.1 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:31.369 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:31.369+0000 7efce025d700 -1 osd.0 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:31.705 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:31.705+0000 7f29d5b73700 -1 osd.1 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:32.329 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:32.329+0000 7efce025d700 -1 osd.0 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:32.711 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:32.711+0000 7f29d5b73700 -1 osd.1 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:33.328 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:33.328+0000 7efce025d700 -1 osd.0 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:33.714 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:33.714+0000 7f29d5b73700 -1 osd.1 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:34.282 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:34.282+0000 7efce025d700 -1 osd.0 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:34.754 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:34.754+0000 7f29d5b73700 -1 osd.1 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:35.290 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:35.290+0000 7efce025d700 -1 osd.0 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:35.760 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:35.760+0000 7f29d5b73700 -1 osd.1 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:36.285 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:36.285+0000 7efce025d700 -1 osd.0 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:36.806 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:36.806+0000 7f29d5b73700 -1 osd.1 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:37.334 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:37.334+0000 7efce025d700 -1 osd.0 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:37.769 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:37.769+0000 7f29d5b73700 -1 osd.1 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:38.287 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:38.287+0000 7efce025d700 -1 osd.0 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:38.817 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:38.816+0000 7f29d5b73700 -1 osd.1 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:39.245 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:39.244+0000 7efce025d700 -1 osd.0 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:39.852 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:39.851+0000 7f29d5b73700 -1 osd.1 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:40.237 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:40.236+0000 7efce025d700 -1 osd.0 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:40.838 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:40.837+0000 7f29d5b73700 -1 osd.1 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:41.245 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:41.244+0000 7efce025d700 -1 osd.0 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:41.847 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:41.846+0000 7f29d5b73700 -1 osd.1 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:42.229 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:42.228+0000 7efce025d700 -1 osd.0 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:42.806 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:42.805+0000 7f29d5b73700 -1 osd.1 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:43.277 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:43.276+0000 7efce025d700 -1 osd.0 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:43.798 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:43.797+0000 7f29d5b73700 -1 osd.1 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:44.305 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:44.304+0000 7efce025d700 -1 osd.0 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:44.814 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:44.813+0000 7f29d5b73700 -1 osd.1 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:45.352 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:45.351+0000 7efce025d700 -1 osd.0 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:45.833 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:45.832+0000 7f29d5b73700 -1 osd.1 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:46.382 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:46.381+0000 7efce025d700 -1 osd.0 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:46.851 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:46.850+0000 7f29d5b73700 -1 osd.1 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:47.430 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:47.429+0000 7efce025d700 -1 osd.0 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:47.818 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:47.818+0000 7f29d5b73700 -1 osd.1 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:48.433 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:48.433+0000 7efce025d700 -1 osd.0 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:48.841 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:48.841+0000 7f29d5b73700 -1 osd.1 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:49.442 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:49.442+0000 7efce025d700 -1 osd.0 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:49.793 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:49.793+0000 7f29d5b73700 -1 osd.1 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:50.416 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:50.416+0000 7efce025d700 -1 osd.0 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:50.844 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:50.844+0000 7f29d5b73700 -1 osd.1 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:51.386 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:51.386+0000 7efce025d700 -1 osd.0 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:51.824 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:51.824+0000 7f29d5b73700 -1 osd.1 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:52.385 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:52.385+0000 7efce025d700 -1 osd.0 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:52.862 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:52.861+0000 7f29d5b73700 -1 osd.1 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:53.401 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:53.401+0000 7efce025d700 -1 osd.0 154 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:53.878 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:53.877+0000 7f29d5b73700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:54.422 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:54.422+0000 7efce025d700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:54.838 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:54.838+0000 7f29d5b73700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:55.381 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:55.381+0000 7efce025d700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:55.852 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:55.852+0000 7f29d5b73700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:56.427 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:56.427+0000 7efce025d700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:56.836 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:56.836+0000 7f29d5b73700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:57.406 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:57.405+0000 7efce025d700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:57.799 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:57.799+0000 7f29d5b73700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:58.394 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:58.394+0000 7efce025d700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:58.842 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:58.842+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:28:59.393 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:28:59.393+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:28:59.826 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:28:59.826+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:00.379 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:00.378+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:00.851 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:00.851+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:01.378 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:01.378+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:01.824 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:01.824+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:02.385 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:02.385+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:02.861 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:02.861+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:03.367 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:03.367+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:03.903 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:03.903+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:04.399 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:04.399+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:04.939 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:04.939+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:05.395 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:05.395+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:05.951 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:05.951+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:06.364 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:06.364+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:06.902 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:06.902+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:07.366 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:07.366+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:07.899 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:07.899+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:08.356 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:08.356+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:08.889 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:08.889+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:09.399 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:09.399+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:09.876 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:09.876+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:10.422 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:10.422+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:10.920 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:10.920+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:11.423 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:11.423+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:11.908 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:11.908+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:12.444 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:12.444+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:12.933 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:12.933+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:13.441 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:13.441+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:13.978 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:13.979+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:14.420 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:14.419+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:14.951 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:14.951+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:15.460 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:15.459+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:15.939 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:15.939+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:16.412 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:16.412+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:16.924 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:16.924+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:17.409 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:17.409+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:17.928 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:17.928+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:18.452 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:18.452+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:18.893 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:18.893+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:19.500 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:19.500+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:19.897 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:19.897+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:20.479 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:20.479+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:20.862 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:20.861+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:21.454 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:21.453+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:21.815 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:21.814+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:22.472 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:22.471+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:22.806 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:22.805+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:23.438 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:23.437+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:23.840 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:23.839+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:24.406 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:24.405+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:24.877 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:24.876+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:25.451 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:25.450+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:25.843 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:25.843+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:26.471 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:26.470+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:26.866 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:26.864+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:27.446 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:27.445+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:27.877 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:27.877+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:28.468 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:28.467+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:28.856 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:28.855+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:29.505 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:29.504+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:29.907 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:29.907+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:30.531 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:30.531+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:30.925 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:30.925+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:31.577 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:31.577+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:31.975 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:31.975+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:32.609 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:32.609+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:32.934 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:32.934+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:33.638 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:33.638+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:33.885 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:33.885+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:34.605 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:34.605+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:34.851 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:34.851+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:35.620 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:35.620+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:35.894 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:35.895+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:36.586 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:36.586+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:36.928 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:36.928+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:37.594 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:37.594+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:37.937 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:37.937+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:38.559 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:38.559+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:38.914 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:38.914+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:39.537 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:39.537+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:39.889 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:39.889+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:40.558 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:40.558+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:40.901 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:40.901+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:41.572 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:41.572+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:41.881 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:41.881+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:42.583 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:42.583+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:42.872 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:42.872+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:43.613 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:43.613+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:43.910 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:43.910+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:44.612 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:44.613+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:44.948 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:44.948+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:45.625 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:45.625+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:45.926 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:45.926+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:46.615 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:46.615+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:46.943 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:46.943+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:47.634 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:47.633+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:47.972 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:47.972+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:48.599 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:48.599+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:48.970 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:48.970+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:49.641 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:49.641+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:50.009 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:50.009+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:50.651 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:50.651+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:50.963 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:50.963+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:51.653 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:51.653+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:51.997 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:51.997+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:52.645 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:52.645+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:53.045 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:53.045+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:53.605 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:53.605+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:54.051 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:54.051+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:54.625 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:54.625+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:55.059 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:55.059+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:55.607 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:55.607+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:56.089 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:56.089+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:56.640 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:56.640+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:57.075 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:57.075+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:57.679 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:57.679+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:58.092 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:58.092+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:58.701 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:58.701+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:29:59.098 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:29:59.098+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:29:59.657 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:29:59.657+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:00.107 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:00.107+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:00.609 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:00.609+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:01.152 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:01.152+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:01.657 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:01.657+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:02.155 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:02.155+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:02.622 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:02.622+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:03.107 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:03.106+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:03.645 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:03.644+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:04.121 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:04.120+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:04.665 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:04.663+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:05.119 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:05.118+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:05.713 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:05.712+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:06.113 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:06.112+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:06.720 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:06.719+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:07.109 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:07.108+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:07.716 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:07.715+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:08.110 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:08.109+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:08.735 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:08.734+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:09.102 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:09.101+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:09.763 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:09.762+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:10.086 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:10.085+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:10.802 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:10.801+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:11.087 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:11.087+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:11.758 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:11.757+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:12.094 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:12.094+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:12.739 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:12.739+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:13.082 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:13.082+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:13.767 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:13.767+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:14.077 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:14.077+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:14.764 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:14.764+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:15.069 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:15.069+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:15.742 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:15.742+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:16.078 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:16.079+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:16.719 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:16.719+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:17.107 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:17.107+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:17.729 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:17.726+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:18.084 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:18.084+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:18.734 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:18.734+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:19.081 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:19.081+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:19.745 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:19.745+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:20.065 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:20.065+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:20.760 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:20.760+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:21.107 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:21.107+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:21.783 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:21.783+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:22.152 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:22.152+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:22.740 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:22.739+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:23.131 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:23.131+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:23.727 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:23.727+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:24.108 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:24.108+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:24.758 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:24.758+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:25.127 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:25.127+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:25.791 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:25.791+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:26.136 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:26.136+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:26.793 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:26.793+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:27.186 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:27.186+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:27.775 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:27.775+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:28.157 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:28.157+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:28.759 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:28.759+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:29.126 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:29.126+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:29.747 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:29.747+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:30.101 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:30.101+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:30.794 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:30.794+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:31.091 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:31.091+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:31.836 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:31.836+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:32.083 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:32.083+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:32.841 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:32.841+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:33.119 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:33.119+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:33.491 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T16:30:33.491+0000 7fa2a9acd700 0 -- 172.21.15.123:0/1871504539 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7fa28c062060 msgr2=0x7fa28c032480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T16:30:33.834 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:33.834+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:34.147 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:34.147+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:34.789 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:34.789+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:35.144 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:35.144+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:35.796 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:35.796+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:36.183 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:36.183+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:36.785 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:36.785+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:37.170 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:37.170+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:37.739 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:37.739+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:38.152 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:38.152+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:38.759 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:38.759+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:39.116 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:39.116+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:39.795 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:39.795+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:40.160 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:40.160+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:40.763 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:40.763+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:41.118 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:41.118+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:41.729 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:41.729+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:42.124 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:42.124+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:42.700 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:42.700+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:43.124 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:43.124+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:43.719 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:43.719+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:44.164 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:44.164+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:44.697 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:44.697+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:45.162 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:45.161+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:45.746 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:45.745+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:46.166 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:46.165+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:46.771 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:46.770+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:47.192 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:47.191+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:47.753 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:47.752+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:48.209 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:48.208+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:48.724 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:48.723+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:49.198 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:49.197+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:49.750 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:49.749+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:50.177 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:50.176+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:50.737 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:50.736+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:51.203 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:51.202+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:51.786 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:51.785+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:52.204 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:52.203+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:52.789 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:52.788+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:53.219 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:53.218+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:53.761 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:53.760+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:54.222 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:54.222+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:54.754 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:54.754+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:55.182 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:55.182+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:55.777 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:55.777+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:56.168 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:56.168+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:56.768 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:56.768+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:57.167 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:57.167+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:57.724 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:57.724+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:58.166 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:58.166+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:58.774 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:58.774+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:30:59.198 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:30:59.198+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:30:59.804 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:30:59.804+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:00.206 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:00.206+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:00.823 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:00.823+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:01.221 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:01.221+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:01.834 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:01.834+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:02.193 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:02.193+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:02.838 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:02.838+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:03.241 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:03.241+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:03.832 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:03.832+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:04.264 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:04.264+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:04.851 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:04.851+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:05.276 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:05.276+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:05.866 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:05.866+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:06.230 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:06.230+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:06.898 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:06.898+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:07.270 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:07.270+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:07.901 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:07.901+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:08.276 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:08.276+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:08.923 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:08.923+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:09.263 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:09.263+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:09.966 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:09.966+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:10.259 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:10.259+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:11.012 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:11.011+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:11.231 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:11.231+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:12.058 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:12.058+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:12.227 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:12.227+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:13.032 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:13.032+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:13.211 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:13.211+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:14.067 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:14.067+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:14.222 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:14.222+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:15.061 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:15.061+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:15.261 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:15.261+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:16.071 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:16.071+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:16.270 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:16.270+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:17.073 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:17.073+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:17.294 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:17.295+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:18.079 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:18.079+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:18.291 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:18.291+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:19.077 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:19.077+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:19.276 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:19.276+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:20.095 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:20.095+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:20.277 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:20.277+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:21.059 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:21.059+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:21.234 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:21.234+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:22.099 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:22.099+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:22.204 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:22.204+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:23.053 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:23.053+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:23.242 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:23.242+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:24.050 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:24.050+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:24.235 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:24.235+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:25.056 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:25.056+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:25.205 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:25.205+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:26.094 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:26.094+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:26.165 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:26.165+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:27.057 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:27.057+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:27.190 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:27.189+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:28.031 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:28.030+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:28.176 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:28.176+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:28.984 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:28.983+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:29.192 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:29.191+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:29.939 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:29.938+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:30.224 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:30.223+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:30.959 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:30.958+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:31.252 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:31.251+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:31.945 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:31.944+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:32.234 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:32.233+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:32.951 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:32.950+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:33.199 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:33.198+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:33.905 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:33.904+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:34.211 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:34.210+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:34.939 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:34.938+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:35.258 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:35.258+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:35.921 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:35.920+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:36.300 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:36.300+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:36.971 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:36.971+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:37.329 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:37.329+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:37.930 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:37.930+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:38.357 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:38.357+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:38.951 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:38.951+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:39.327 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:39.327+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:39.944 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:39.944+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:40.348 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:40.348+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:40.974 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:40.974+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:41.312 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:41.312+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:41.951 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:41.951+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:42.270 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:42.270+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:42.983 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:42.983+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:43.311 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:43.311+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:43.971 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:43.971+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:44.333 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:44.333+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:44.954 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:44.954+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:45.300 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:45.300+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:45.917 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:45.917+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:46.347 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:46.347+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:46.946 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:46.946+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:47.348 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:47.348+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:47.909 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:47.909+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:48.307 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:48.307+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:48.895 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:48.895+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:49.317 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:49.317+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:49.919 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:49.919+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:50.334 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:50.334+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:50.966 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:50.966+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:51.317 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:51.317+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:51.922 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:51.922+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:52.365 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:52.365+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:52.903 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:52.903+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:53.338 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:53.338+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:53.948 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:53.948+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:54.318 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:54.318+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:54.947 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:54.947+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:55.295 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:55.295+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:55.979 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:55.979+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:56.308 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:56.308+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:56.997 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:56.997+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:57.349 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:57.349+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:57.950 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:57.950+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:58.330 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:58.330+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:59.000 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:59.000+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:31:59.282 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:31:59.283+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:31:59.982 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:31:59.982+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:00.245 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:00.245+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:01.000 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:01.000+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:01.233 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:01.233+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:02.047 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:02.047+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:02.262 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:02.262+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:03.071 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:03.071+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:03.249 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:03.249+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:04.056 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:04.056+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:04.288 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:04.288+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:05.089 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:05.089+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:05.266 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:05.266+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:06.093 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:06.093+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:06.271 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:06.271+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:07.089 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:07.089+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:07.284 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:07.284+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:08.116 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:08.116+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:08.240 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:08.240+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:09.115 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:09.115+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:09.194 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:09.193+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:10.100 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:10.100+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:10.145 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:10.144+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:11.109 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:11.108+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:11.120 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:11.120+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:12.143 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:12.142+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:12.150 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:12.149+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:13.138 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:13.137+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:13.164 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:13.163+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:14.121 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:14.120+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:14.177 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:14.176+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:15.169 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:15.168+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:15.224 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:15.223+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:16.211 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:16.210+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:16.246 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:16.245+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:17.166 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:17.165+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:17.220 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:17.219+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:18.161 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:18.161+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:18.206 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:18.207+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:19.199 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:19.199+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:19.249 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:19.249+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:20.227 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:20.227+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:20.227 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:20.228+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:21.191 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:21.191+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:21.256 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:21.256+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:22.225 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:22.225+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:22.226 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:22.227+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:23.183 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:23.183+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:23.235 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:23.235+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:24.210 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:24.210+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:24.230 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:24.230+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:25.169 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:25.169+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:25.187 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:25.187+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:26.140 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:26.140+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:26.211 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:26.211+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:27.180 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:27.180+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:27.190 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:27.191+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:28.141 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:28.141+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:28.154 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:28.155+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:29.165 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:29.165+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:29.199 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:29.199+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:30.211 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:30.211+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:30.243 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:30.243+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:31.239 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:31.239+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:31.270 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:31.270+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:32.259 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:32.259+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:32.276 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:32.276+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:33.259 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:33.259+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:33.289 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:33.289+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:34.211 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:34.211+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:34.278 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:34.278+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:35.211 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:35.211+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:35.325 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:35.325+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:36.226 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:36.226+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:36.278 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:36.278+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:37.205 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:37.205+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:37.279 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:37.279+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:38.253 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:38.253+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:38.318 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:38.318+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:39.257 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:39.257+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:39.291 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:39.291+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:40.223 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:40.223+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:40.321 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:40.321+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:41.195 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:41.195+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:41.338 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:41.338+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:42.213 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:42.213+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:42.367 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:42.367+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:43.230 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:43.230+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:43.387 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:43.387+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:44.249 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:44.249+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:44.428 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:44.428+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:45.257 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:45.257+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:45.411 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:45.411+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:46.240 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:46.240+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:46.432 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:46.432+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:47.239 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:47.239+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:47.463 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:47.463+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:48.234 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:48.234+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:48.450 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:48.450+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:49.210 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:49.210+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:49.479 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:49.479+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:50.218 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:50.219+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:50.457 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:50.457+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:51.205 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:51.204+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:51.419 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:51.418+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:52.157 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:52.156+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:52.441 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:52.440+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:53.160 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:53.159+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:53.425 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:53.423+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:54.191 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:54.190+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:54.448 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:54.448+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:55.209 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:55.208+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:55.498 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:55.497+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:56.253 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:56.252+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:56.450 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:56.450+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:57.248 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:57.247+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:57.483 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:57.482+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:58.212 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:58.211+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:58.465 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:58.465+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:32:59.188 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:32:59.188+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:32:59.418 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:32:59.417+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:00.139 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:00.139+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:00.447 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:00.447+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:01.156 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:01.156+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:01.489 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:01.489+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:02.170 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:02.170+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:02.479 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:02.479+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:03.122 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:03.122+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:03.450 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:03.448+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:04.157 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:04.157+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:04.405 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:04.405+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:05.131 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:05.131+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:05.453 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:05.453+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:06.097 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:06.097+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:06.459 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:06.458+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:07.123 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:07.123+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:07.483 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:07.483+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:08.171 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:08.171+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:08.505 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:08.505+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:09.167 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:09.167+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:09.541 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:09.541+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:10.181 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:10.181+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:10.541 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:10.541+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:11.211 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:11.211+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:11.576 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:11.576+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:12.177 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:12.177+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:12.577 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:12.576+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:13.152 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:13.152+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:13.606 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:13.606+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:14.119 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:14.119+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:14.567 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:14.567+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:15.121 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:15.121+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:15.562 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:15.562+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:16.218 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:16.119+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:16.543 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:16.543+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:17.164 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:17.164+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:17.579 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:17.579+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:18.169 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:18.169+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:18.590 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:18.590+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:19.171 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:19.171+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:19.613 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:19.613+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:20.205 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:20.205+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:20.625 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:20.625+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:21.217 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:21.217+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:21.665 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:21.665+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:22.176 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:22.177+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:22.713 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:22.713+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:23.130 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:23.130+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:23.711 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:23.711+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:24.177 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:24.177+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:24.737 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:24.737+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:25.191 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:25.191+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:25.713 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:25.713+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:26.229 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:26.229+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:26.717 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:26.717+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:27.249 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:27.248+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:27.716 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:27.699+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:28.270 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:28.270+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:28.706 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:28.706+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:29.311 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:29.311+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:29.706 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:29.706+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:30.346 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:30.346+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:30.694 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:30.695+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:31.319 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:31.319+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:31.743 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:31.743+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:32.315 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:32.314+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:32.757 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:32.756+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:33.315 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:33.314+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:33.776 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:33.775+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:34.324 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:34.323+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:34.765 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:34.764+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:35.372 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:35.371+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:35.717 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:35.716+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:36.380 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:36.379+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:36.682 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:36.681+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:37.395 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:37.394+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:37.665 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:37.664+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:38.437 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:38.436+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:38.695 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:38.694+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:39.400 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:39.400+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:39.701 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:39.700+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:40.440 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:40.440+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:40.701 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:40.701+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:41.423 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:41.423+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:41.737 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:41.737+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:42.395 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:42.394+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:42.704 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:42.704+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:43.381 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:43.381+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:43.737 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:43.737+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:44.369 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:44.369+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:44.758 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:44.758+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:45.393 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:45.393+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:45.730 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:45.730+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:46.406 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:46.406+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:46.726 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:46.726+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:47.399 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:47.399+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:47.726 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:47.726+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:48.396 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:48.396+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:48.751 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:48.751+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:49.387 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:49.387+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:49.767 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:49.767+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:50.415 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:50.415+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:50.737 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:50.737+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:51.457 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:51.457+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:51.769 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:51.769+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:52.458 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:52.458+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:52.788 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:52.788+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:53.454 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:53.454+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:53.774 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:53.774+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:54.455 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:54.455+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:54.818 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:54.818+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:55.477 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:55.477+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:55.819 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:55.819+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:56.524 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:56.524+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:56.785 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:56.785+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:57.533 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:57.533+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:57.782 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:57.782+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:58.546 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:58.546+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:58.808 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:58.808+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:33:59.498 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:33:59.498+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:33:59.853 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:33:59.853+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:00.533 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:00.533+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:00.896 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:00.896+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:01.577 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:01.577+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:01.946 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:01.946+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:02.561 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:02.561+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:02.964 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:02.964+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:03.569 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:03.569+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:03.986 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:03.986+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:04.546 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:04.546+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:04.980 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:04.981+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:05.519 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:05.519+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:05.932 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:05.932+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:06.531 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:06.531+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:06.935 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:06.935+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:07.531 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:07.531+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:07.922 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:07.922+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:08.517 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:08.517+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:08.889 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:08.889+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:09.548 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:09.548+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:09.929 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:09.929+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:10.590 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:10.590+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:10.952 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:10.952+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:11.550 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:11.550+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:11.926 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:11.924+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:12.560 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:12.559+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:12.877 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:12.876+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:13.555 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:13.554+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:13.857 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:13.856+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:14.523 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:14.522+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:14.855 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:14.854+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:15.549 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:15.548+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:15.871 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:15.870+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:16.515 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:16.514+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:16.890 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:16.889+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:17.521 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:17.520+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:17.843 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:17.842+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:18.537 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:18.536+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:18.795 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:18.794+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:19.515 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:19.514+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:19.783 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:19.782+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:20.565 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:20.565+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:20.806 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:20.806+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:21.552 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:21.552+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:21.788 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:21.788+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:22.586 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:22.586+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:22.805 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:22.805+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:23.596 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:23.596+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:23.791 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:23.791+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:24.565 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:24.565+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:24.840 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:24.840+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:25.594 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:25.594+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:25.877 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:25.875+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:26.594 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:26.594+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:26.901 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:26.901+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:27.636 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:27.636+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:27.930 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:27.930+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:28.642 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:28.642+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:28.914 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:28.914+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:29.610 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:29.610+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:29.958 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:29.958+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:30.618 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:30.618+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:30.968 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:30.968+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:31.610 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:31.610+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:32.009 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:32.009+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:32.588 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:32.588+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:33.025 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:33.025+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:33.587 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:33.587+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:33.995 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:33.995+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:34.587 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:34.587+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:34.970 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:34.970+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:35.631 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:35.631+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:35.973 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:35.973+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:36.616 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:36.616+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:36.934 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:36.934+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:37.588 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:37.588+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:37.985 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:37.984+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:38.615 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:38.615+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:38.973 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:38.973+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:39.631 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:39.631+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:39.954 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:39.954+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:40.649 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:40.649+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:40.981 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:40.981+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:41.697 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:41.697+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:42.028 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:42.028+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:42.745 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:42.745+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:43.045 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:43.045+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:43.727 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:43.727+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:44.056 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:44.056+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:44.712 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:44.712+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:45.018 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:45.018+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:45.726 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:45.726+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:46.046 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:46.046+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:46.694 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:46.694+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:47.075 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:47.075+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:47.680 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:47.680+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:48.034 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:48.034+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:48.638 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:48.638+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:49.038 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:49.038+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:49.612 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:49.612+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:50.011 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:50.011+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:50.645 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:50.644+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:51.032 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:51.031+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:51.612 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:51.611+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:52.006 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:52.005+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:52.644 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:52.643+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:53.026 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:53.025+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:53.677 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:53.676+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:54.002 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:54.001+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:54.660 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:54.659+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:55.019 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:55.018+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:55.676 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:55.675+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:56.002 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:56.001+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:56.715 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:56.714+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:57.024 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:57.023+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:57.763 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:57.762+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:58.072 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:58.071+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:58.744 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:58.744+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:34:59.030 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:34:59.030+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:34:59.792 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:34:59.792+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:00.025 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:00.025+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:00.832 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:00.832+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:01.003 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:01.003+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:01.801 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:01.801+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:02.017 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:02.017+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:02.772 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:02.772+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:03.036 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:03.036+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:03.783 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:03.783+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:04.033 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:04.033+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:04.819 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:04.819+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:05.005 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:05.005+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:05.827 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:05.826+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:06.015 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:06.015+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:06.855 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:06.855+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:07.060 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:07.060+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:07.867 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:07.867+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:08.066 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:08.066+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:08.915 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:08.915+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:09.101 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:09.100+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:09.932 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:09.932+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:10.119 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:10.119+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:10.885 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:10.885+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:11.112 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:11.112+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:11.839 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:11.839+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:12.147 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:12.147+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:12.826 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:12.826+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:13.191 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:13.191+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:13.809 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:13.808+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:14.191 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:14.190+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:14.859 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:14.859+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:15.192 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:15.192+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:15.896 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:15.896+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:16.144 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:16.144+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:16.925 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:16.925+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:17.145 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:17.145+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:17.879 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:17.879+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:18.175 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:18.175+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:18.859 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:18.859+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:19.195 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:19.195+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:19.899 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:19.899+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:20.238 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:20.238+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:20.941 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:20.941+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:21.229 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:21.229+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:21.898 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:21.898+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:22.220 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:22.220+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:22.907 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:22.907+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:23.247 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:23.247+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:23.931 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:23.931+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:24.215 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:24.215+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:24.963 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:24.962+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:25.171 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:25.171+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:25.975 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:25.975+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:26.153 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:26.153+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:27.023 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:27.023+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:27.116 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:27.116+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:27.985 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:27.985+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:28.073 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:28.073+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:28.975 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:28.974+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:29.054 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:29.053+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:29.988 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:29.987+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:30.012 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:30.011+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:31.009 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:31.008+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:31.035 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:31.034+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:32.031 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:32.030+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:32.035 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:32.034+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:32.985 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:32.984+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:33.066 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:33.065+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:33.957 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:33.956+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:34.087 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:34.086+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:34.931 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:34.929+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:35.085 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:35.083+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:35.920 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:35.918+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:36.101 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:36.100+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:36.948 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:36.947+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:37.110 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:37.109+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:37.982 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:37.981+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:38.148 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:38.147+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:39.019 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:39.019+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:39.185 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:39.185+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:39.973 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:39.973+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:40.177 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:40.177+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:41.016 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:41.016+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:41.141 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:41.141+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:42.040 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:42.040+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:42.169 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:42.168+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:43.015 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:43.015+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:43.165 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:43.165+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:43.984 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:43.983+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:44.203 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:44.203+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:45.015 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:45.014+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:45.188 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:45.187+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:46.016 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:46.016+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:46.186 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:46.186+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:46.972 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:46.971+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:47.158 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:47.158+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:47.985 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:47.984+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:48.160 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:48.160+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:48.992 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:48.991+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:49.187 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:49.186+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:50.006 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:50.005+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:50.228 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:50.227+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:50.998 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:50.998+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:51.260 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:51.259+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:52.044 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:52.044+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:52.266 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:52.266+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:53.078 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:53.078+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:53.239 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:53.238+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:54.059 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:54.059+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:54.269 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:54.269+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:55.028 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:55.028+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:55.272 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:55.272+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:56.016 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:56.016+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:56.266 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:56.266+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:56.984 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:56.984+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:57.288 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:57.288+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:57.959 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:57.958+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:58.260 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:58.260+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:58.997 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:58.996+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:35:59.288 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:35:59.287+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:35:59.963 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:35:59.963+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:00.331 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:00.331+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:00.955 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:00.954+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:01.295 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:01.295+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:01.942 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:01.941+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:02.338 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:02.338+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:02.894 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:02.893+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:03.308 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:03.308+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:03.896 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:03.896+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:04.278 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:04.278+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:04.931 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:04.930+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:05.304 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:05.304+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:05.927 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:05.927+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:06.327 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:06.326+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:06.888 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:06.888+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:07.326 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:07.325+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:07.866 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:07.866+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:08.362 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:08.361+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:08.913 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:08.911+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:09.315 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:09.314+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:09.934 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:09.932+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:10.289 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:10.288+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:10.938 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:10.937+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:11.246 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:11.245+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:11.983 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:11.981+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:12.239 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:12.237+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:12.943 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:12.941+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:13.284 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:13.282+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:13.906 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:13.904+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:14.329 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:14.327+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:14.866 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:14.865+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:15.315 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:15.313+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:15.912 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:15.910+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:16.324 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:16.323+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:16.866 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:16.865+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:17.327 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:17.327+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:17.879 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:17.879+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:18.367 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:18.367+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:18.853 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:18.852+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:19.337 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:19.336+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:19.859 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:19.858+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:20.385 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:20.384+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:20.906 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:20.906+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:21.409 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:21.409+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:21.931 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:21.930+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:22.407 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:22.407+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:22.975 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:22.974+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:23.422 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:23.421+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:24.023 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:24.022+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:24.383 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:24.382+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:24.983 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:24.983+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:25.393 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:25.392+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:25.970 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:25.970+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:26.347 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:26.347+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:26.969 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:26.969+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:27.393 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:27.393+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:28.004 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:28.004+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:28.345 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:28.345+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:28.961 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:28.960+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:29.315 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:29.315+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:29.949 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:29.949+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:30.317 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:30.317+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:30.923 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:30.922+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:31.351 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:31.350+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:31.902 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:31.901+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:32.352 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:32.352+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:32.937 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:32.937+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:33.376 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:33.376+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:33.969 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:33.968+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:34.369 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:34.369+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:34.997 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:34.996+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:35.387 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:35.386+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:35.959 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:35.959+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:36.410 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:36.409+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:36.974 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:36.973+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:37.421 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:37.421+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:37.987 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:37.987+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:38.373 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:38.373+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:39.033 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:39.033+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:39.372 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:39.372+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:39.991 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:39.991+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:40.400 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:40.399+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:41.037 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:41.037+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:41.444 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:41.444+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:41.990 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:41.990+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:42.473 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:42.473+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:42.975 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:42.975+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:43.507 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:43.506+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:43.934 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:43.933+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:44.467 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:44.467+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:44.927 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:44.927+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:45.477 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:45.477+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:45.911 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:45.910+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:46.487 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:46.486+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:46.926 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:46.925+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:47.509 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:47.509+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:47.926 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:47.926+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:48.506 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:48.504+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:48.954 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:48.952+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:49.474 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:49.472+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:49.915 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:49.914+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:50.454 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:50.453+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:50.936 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:50.934+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:51.435 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:51.434+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:51.978 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:51.976+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:52.453 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:52.452+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:52.949 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:52.947+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:53.423 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:53.422+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:53.961 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:53.959+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:54.469 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:54.467+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:55.003 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:55.002+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:55.519 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:55.517+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:56.043 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:56.043+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:56.514 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:56.513+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:57.042 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:57.041+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:57.470 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:57.469+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:58.043 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:58.043+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:58.487 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:58.486+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:58.998 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:58.998+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:36:59.450 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:36:59.449+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:36:59.961 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:36:59.960+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:00.421 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:00.420+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:00.958 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:00.957+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:01.459 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:01.459+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:01.999 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:01.998+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:02.415 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:02.415+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:02.986 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:02.985+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:03.442 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:03.441+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:03.962 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:03.962+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:04.427 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:04.426+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:04.934 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:04.934+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:05.415 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:05.415+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:05.908 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:05.907+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:06.435 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:06.434+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:06.860 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:06.860+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:07.431 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:07.431+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:07.911 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:07.911+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:08.421 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:08.420+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:08.910 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:08.909+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:09.463 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:09.463+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:09.952 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:09.951+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:10.503 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:10.502+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:10.953 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:10.953+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:11.552 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:11.551+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:11.935 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:11.935+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:12.528 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:12.528+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:12.980 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:12.979+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:13.515 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:13.514+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:14.020 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:14.020+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:14.482 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:14.481+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:15.043 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:15.042+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:15.470 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:15.469+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:16.088 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:16.088+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:16.446 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:16.446+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:17.126 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:17.126+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:17.448 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:17.447+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:18.106 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:18.105+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:18.461 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:18.461+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:19.069 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:19.069+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:19.506 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:19.505+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:20.064 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:20.063+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:20.537 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:20.536+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:21.060 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:21.059+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:21.569 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:21.568+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:22.021 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:22.020+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:22.541 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:22.541+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:23.003 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:23.002+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:23.573 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:23.573+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:24.028 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:23.991+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:24.590 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:24.590+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:25.026 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:25.025+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:25.618 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:25.617+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:25.978 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:25.977+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:26.644 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:26.643+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:27.020 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:27.020+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:27.595 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:27.595+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:28.058 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:28.057+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:28.560 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:28.558+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:29.034 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:29.032+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:29.527 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:29.526+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:30.045 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:30.043+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:30.540 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:30.538+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:31.000 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:30.998+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:31.553 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:31.551+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:32.006 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:32.004+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:32.568 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:32.566+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:33.019 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:33.017+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:33.585 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:33.584+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:34.058 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:34.056+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:34.537 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:34.536+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:35.064 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:35.062+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:35.587 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:35.586+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:36.110 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:36.109+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:36.618 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:36.617+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:37.112 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:37.110+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:37.622 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:37.621+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:38.063 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:38.063+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:38.582 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:38.581+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:39.091 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:39.090+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:39.585 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:39.584+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:40.119 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:40.119+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:40.621 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:40.620+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:41.159 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:41.158+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:41.597 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:41.596+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:42.150 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:42.149+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:42.645 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:42.645+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:43.177 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:43.177+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:43.695 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:43.694+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:44.218 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:44.217+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:44.709 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:44.708+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:45.175 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:45.174+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:45.664 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:45.663+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:46.197 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:46.196+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:46.687 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:46.686+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:47.226 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:47.225+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:47.681 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:47.680+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:48.238 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:48.237+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:48.698 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:48.697+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:49.257 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:49.256+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:49.660 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:49.659+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:50.213 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:50.212+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:50.656 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:50.655+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:51.207 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:51.207+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:51.699 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:51.698+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:52.175 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:52.174+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:52.688 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:52.687+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:53.134 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:53.133+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:53.714 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:53.713+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:54.097 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:54.096+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:54.701 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:54.701+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:55.084 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:55.083+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:55.723 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:55.722+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:56.132 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:56.131+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:56.759 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:56.759+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:57.099 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:57.098+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:57.762 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:57.761+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:58.145 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:58.144+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:58.728 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:58.727+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:37:59.118 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:37:59.117+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:37:59.687 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:37:59.686+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:00.152 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:00.151+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:00.725 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:00.724+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:01.163 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:01.162+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:01.762 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:01.761+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:02.196 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:02.195+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:02.740 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:02.739+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:03.181 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:03.180+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:03.710 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:03.709+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:04.168 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:04.167+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:04.679 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:04.678+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:05.159 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:05.158+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:05.644 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:05.643+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:06.173 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:06.172+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:06.620 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:06.619+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:07.175 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:07.174+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:07.579 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:07.578+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:08.189 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:08.188+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:08.596 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:08.595+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:09.226 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:09.225+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:09.574 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:09.573+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:10.226 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:10.225+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:10.611 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:10.610+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:11.273 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:11.271+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:11.625 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:11.623+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:12.310 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:12.308+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:12.656 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:12.654+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:13.292 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:13.290+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:13.669 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:13.667+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:14.294 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:14.292+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:14.718 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:14.716+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:15.331 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:15.329+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:15.741 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:15.739+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:16.343 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:16.341+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:16.781 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:16.779+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:17.341 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:17.339+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:17.732 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:17.730+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:18.387 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:18.386+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:18.776 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:18.775+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:19.353 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:19.352+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:19.738 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:19.737+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:20.333 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:20.332+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:20.779 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:20.777+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:21.315 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:21.314+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:21.782 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:21.778+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:22.365 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:22.363+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:22.788 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:22.787+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:23.411 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:23.410+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:23.833 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:23.832+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:24.414 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:24.413+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:24.839 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:24.838+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:25.447 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:25.446+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:25.815 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:25.814+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:26.432 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:26.431+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:26.838 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:26.837+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:27.424 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:27.423+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:27.798 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:27.797+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:28.467 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:28.466+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:28.787 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:28.786+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:29.445 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:29.444+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:29.836 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:29.835+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:30.429 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:30.428+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:30.805 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:30.804+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:31.418 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:31.417+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:31.784 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:31.783+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:32.391 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:32.390+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:32.800 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:32.799+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:33.367 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:33.366+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:33.772 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:33.771+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:34.345 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:34.344+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:34.782 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:34.781+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:35.330 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:35.329+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:35.754 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:35.752+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:36.327 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:36.326+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:36.766 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:36.765+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:37.293 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:37.292+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:37.816 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:37.815+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:38.254 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:38.253+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:38.812 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:38.811+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:39.258 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:39.257+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:39.834 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:39.833+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:40.289 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:40.288+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:40.858 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:40.857+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:41.322 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:41.321+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:41.825 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:41.824+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:42.278 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:42.277+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:42.791 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:42.790+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:43.249 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:43.248+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:43.832 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:43.830+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:44.203 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:44.202+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:44.823 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:44.822+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:45.246 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:45.245+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:45.803 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:45.802+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:46.231 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:46.230+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:46.758 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:46.757+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:47.210 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:47.209+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:47.785 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:47.784+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:48.162 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:48.161+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:48.815 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:48.814+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:49.174 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:49.172+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:49.771 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:49.770+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:50.147 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:50.146+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:50.822 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:50.821+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:51.192 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:51.190+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:51.787 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:51.785+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:52.188 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:52.186+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:52.820 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:52.818+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:53.212 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:53.210+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:53.794 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:53.792+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:54.195 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:54.192+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:54.759 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:54.756+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:55.168 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:55.166+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:55.790 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:55.787+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:56.128 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:56.126+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:56.837 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:56.835+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:57.150 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:57.148+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:57.878 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:57.874+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:58.165 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:58.162+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:58.893 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:58.891+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:38:59.164 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:38:59.162+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:38:59.937 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:38:59.936+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:00.166 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:00.164+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:00.929 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:00.928+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:01.163 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:01.161+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:01.943 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:01.942+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:02.137 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:02.135+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:02.897 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:02.896+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:03.097 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:03.095+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:03.915 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:03.914+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:04.127 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:04.125+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:04.897 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:04.896+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:05.131 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:05.130+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:05.886 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:05.885+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:06.103 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:06.102+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:06.924 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:06.923+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:07.095 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:07.094+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:07.923 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:07.922+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:08.124 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:08.123+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:08.935 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:08.934+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:09.088 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:09.086+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:09.962 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:09.960+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:10.111 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:10.110+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:10.985 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:10.984+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:11.084 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:11.082+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:11.954 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:11.953+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:12.048 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:12.046+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:12.979 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:12.978+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:13.042 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:13.041+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:13.974 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:13.973+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:14.067 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:14.066+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:14.941 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:14.939+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:15.075 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:15.074+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:15.935 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:15.934+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:16.124 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:16.123+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:16.974 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:16.973+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:17.141 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:17.140+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:17.974 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:17.972+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:18.103 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:18.102+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:19.023 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:19.022+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:19.106 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:19.105+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:20.022 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:20.020+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:20.128 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:20.126+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:21.048 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:21.046+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:21.135 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:21.134+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:22.046 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:22.045+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:22.133 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:22.132+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:23.021 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:23.020+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:23.107 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:23.106+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:23.988 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:23.987+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:24.086 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:24.085+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:25.011 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:25.010+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:25.039 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:25.038+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:26.049 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:26.048+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:26.054 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:26.053+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:27.028 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:27.027+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:27.069 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:27.068+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:28.059 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:28.058+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:28.073 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:28.072+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:29.063 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:29.062+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:29.080 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:29.079+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:30.058 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:30.057+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:30.095 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:30.094+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:31.073 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:31.072+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:31.094 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:31.093+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:32.040 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:32.038+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:32.095 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:32.094+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:33.047 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:33.046+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:33.086 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:33.085+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:34.091 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:34.088+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:34.107 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:34.105+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:35.071 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:35.069+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:35.121 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:35.119+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:36.039 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:36.036+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:36.089 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:36.087+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:37.020 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:37.017+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:37.061 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:37.059+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:37.983 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:37.981+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:38.069 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:38.067+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:38.987 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:38.985+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:39.086 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:39.084+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:39.961 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:39.958+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:40.045 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:40.043+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:40.958 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:40.956+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:41.033 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:41.031+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:41.982 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:41.980+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:42.071 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:42.069+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:42.949 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:42.948+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:43.034 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:43.033+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:43.911 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:43.910+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:44.011 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:44.009+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:44.928 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:44.927+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:45.037 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:45.036+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:45.945 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:45.943+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:46.038 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:46.036+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:46.906 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:46.905+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:47.081 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:47.079+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:47.858 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:47.857+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:48.088 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:48.087+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:48.857 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:48.855+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:49.124 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:49.123+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:49.845 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:49.844+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:50.092 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:50.091+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:50.811 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:50.809+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:51.095 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:51.094+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:51.781 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:51.780+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:52.074 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:52.073+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:52.753 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:52.752+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:53.109 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:53.107+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:53.731 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:53.730+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:54.100 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:54.099+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:54.699 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:54.698+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:55.121 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:55.119+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:55.702 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:55.701+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:56.131 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:56.130+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:56.691 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:56.689+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:57.143 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:57.142+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:57.684 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:57.682+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:58.123 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:58.121+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:58.662 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:58.660+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:39:59.096 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:39:59.094+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:39:59.687 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:39:59.686+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:00.119 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:00.117+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:00.701 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:00.700+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:01.167 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:01.165+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:01.707 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:01.705+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:02.127 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:02.126+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:02.708 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:02.707+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:03.175 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:03.173+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:03.679 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:03.678+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:04.146 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:04.145+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:04.630 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:04.629+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:05.141 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:05.140+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:05.589 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:05.588+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:06.171 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:06.169+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:06.556 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:06.554+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:07.152 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:07.150+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:07.511 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:07.510+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:08.194 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:08.193+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:08.533 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:08.532+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:09.170 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:09.169+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:09.523 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:09.521+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:10.216 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:10.215+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:10.493 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:10.491+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:11.168 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:11.166+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:11.486 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:11.485+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:12.129 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:12.128+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:12.469 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:12.468+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:13.173 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:13.171+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:13.434 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:13.432+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:14.140 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:14.138+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:14.428 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:14.426+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:15.185 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:15.182+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:15.392 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:15.389+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:16.203 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:16.201+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:16.425 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:16.422+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:17.195 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:17.192+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:17.397 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:17.394+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:18.150 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:18.147+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:18.399 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:18.396+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:19.147 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:19.145+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:19.374 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:19.371+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:20.193 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:20.191+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:20.339 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:20.336+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:21.154 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:21.151+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:21.337 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:21.334+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:22.105 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:22.103+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:22.291 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:22.288+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:23.111 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:23.109+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:23.288 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:23.286+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:24.089 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:24.088+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:24.333 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:24.332+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:25.094 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:25.092+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:25.289 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:25.288+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:26.055 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:26.053+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:26.297 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:26.296+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:27.062 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:27.060+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:27.283 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:27.281+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:28.019 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:28.017+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:28.309 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:28.308+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:29.045 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:29.044+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:29.279 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:29.278+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:30.015 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:30.013+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:30.241 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:30.239+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:31.015 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:31.014+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:31.260 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:31.258+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:32.003 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:32.002+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:32.249 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:32.248+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:32.995 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:32.993+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:33.248 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:33.246+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:33.947 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:33.946+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:34.270 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:34.269+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:34.979 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:34.978+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:35.227 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:35.225+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:35.960 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:35.958+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:36.273 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:36.271+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:36.925 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:36.924+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:37.320 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:37.319+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:37.885 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:37.884+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:38.334 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:38.332+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:38.875 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:38.874+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:39.349 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:39.348+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:39.921 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:39.920+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:40.318 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:40.316+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:40.879 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:40.878+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:41.317 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:41.316+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:41.921 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:41.920+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:42.312 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:42.310+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:42.971 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:42.969+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:43.304 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:43.303+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:43.933 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:43.932+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:44.288 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:44.286+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:44.892 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:44.890+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:45.337 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:45.335+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:45.863 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:45.862+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:46.288 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:46.286+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:46.827 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:46.825+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:47.335 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:47.333+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:47.851 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:47.850+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:48.376 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:48.375+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:48.899 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:48.897+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:49.385 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:49.384+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:49.947 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:49.946+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:50.428 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:50.426+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:50.975 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:50.974+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:51.438 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:51.436+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:51.953 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:51.952+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:52.413 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:52.412+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:52.915 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:52.914+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:53.445 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:53.444+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:53.957 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:53.954+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:54.425 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:54.424+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:54.959 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:54.958+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:55.437 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:55.436+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:55.934 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:55.932+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:56.461 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:56.460+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:56.901 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:56.899+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:57.469 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:57.458+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:57.911 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:57.909+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:58.426 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:58.423+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:58.916 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:58.913+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:40:59.425 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:40:59.423+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:40:59.953 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:40:59.951+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:00.432 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:00.429+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:00.938 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:00.935+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:01.482 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:01.479+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:01.903 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:01.900+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:02.519 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:02.516+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:02.947 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:02.945+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:03.515 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:03.512+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:03.951 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:03.949+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:04.495 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:04.493+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:04.983 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:04.980+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:05.453 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:05.451+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:05.988 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:05.986+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:06.407 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:06.406+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:06.979 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:06.977+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:07.433 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:07.432+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:08.009 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:08.007+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:08.465 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:08.464+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:08.984 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:08.983+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:09.418 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:09.417+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:09.971 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:09.969+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:10.451 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:10.450+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:10.991 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:10.990+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:11.423 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:11.422+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:11.989 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:11.987+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:12.395 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:12.394+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:13.017 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:13.016+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:13.352 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:13.351+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:14.028 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:14.026+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:14.372 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:14.371+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:15.044 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:15.043+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:15.352 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:15.351+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:16.061 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:16.060+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:16.304 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:16.302+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:17.018 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:17.017+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:17.344 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:17.342+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:18.037 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:18.036+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:18.308 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:18.306+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:19.027 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:19.025+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:19.259 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:19.258+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:19.984 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:19.983+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:20.301 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:20.300+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:20.957 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:20.955+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:21.335 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:21.334+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:21.925 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:21.922+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:22.323 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:22.321+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:22.958 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:22.956+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:23.344 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:23.342+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:23.946 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:23.944+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:24.348 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:24.347+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:24.932 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:24.930+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:25.368 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:25.366+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:25.891 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:25.890+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:26.402 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:26.400+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:26.895 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:26.894+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:27.422 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:27.420+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:27.901 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:27.900+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:28.456 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:28.455+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:28.857 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:28.855+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:29.496 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:29.494+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:29.890 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:29.888+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:30.455 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:30.454+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:30.863 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:30.861+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:31.444 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:31.442+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:31.893 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:31.892+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:32.429 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:32.428+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:32.929 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:32.928+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:33.405 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:33.404+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:33.918 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:33.916+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:34.376 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:34.375+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:34.928 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:34.926+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:35.342 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:35.341+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:35.944 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:35.942+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:36.294 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:36.292+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:36.986 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:36.985+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:37.250 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:37.248+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:37.983 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:37.981+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:38.283 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:38.281+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:39.016 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:39.013+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:39.276 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:39.273+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:40.033 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:40.031+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:40.295 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:40.293+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:41.080 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:41.077+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:41.269 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:41.266+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:42.083 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:42.081+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:42.259 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:42.256+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:43.056 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:43.053+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:43.223 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:43.221+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:44.093 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:44.090+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:44.263 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:44.260+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:45.056 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:45.053+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:45.250 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:45.248+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:46.084 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:46.081+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:46.262 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:46.259+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:47.131 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:47.128+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:47.278 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:47.275+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:48.087 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:48.085+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:48.297 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:48.295+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:49.128 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:49.127+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:49.252 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:49.250+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:50.107 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:50.105+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:50.274 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:50.272+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:51.114 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:51.113+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:51.249 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:51.247+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:52.074 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:52.072+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:52.245 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:52.243+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:53.058 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:53.056+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:53.267 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:53.266+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:54.084 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:54.082+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:54.237 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:54.236+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:55.112 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:55.110+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:55.245 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:55.244+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:56.070 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:56.068+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:56.208 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:56.207+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:57.050 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:57.049+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:57.247 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:57.246+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:58.003 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:58.002+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:58.289 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:58.288+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:59.004 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:59.002+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:41:59.310 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:41:59.308+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:41:59.973 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:41:59.971+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:00.328 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:00.326+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:01.000 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:00.998+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:01.317 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:01.315+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:01.976 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:01.975+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:02.326 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:02.324+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:03.005 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:03.003+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:03.304 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:03.302+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:03.997 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:03.995+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:04.301 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:04.299+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:05.004 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:05.002+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:05.322 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:05.320+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:05.969 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:05.967+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:06.326 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:06.324+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:06.962 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:06.961+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:07.291 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:07.289+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:07.917 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:07.915+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:08.255 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:08.254+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:08.960 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:08.959+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:09.239 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:09.237+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:09.952 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:09.951+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:10.274 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:10.273+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:10.969 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:10.968+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:11.251 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:11.249+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:12.000 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:11.998+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:12.262 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:12.260+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:12.965 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:12.963+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:13.216 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:13.214+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:13.936 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:13.935+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:14.250 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:14.248+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:14.898 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:14.896+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:15.253 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:15.251+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:15.920 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:15.918+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:16.231 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:16.229+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:16.933 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:16.931+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:17.239 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:17.238+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:17.902 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:17.900+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:18.267 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:18.266+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:18.909 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:18.907+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:19.250 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:19.248+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:19.920 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:19.918+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:20.255 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:20.254+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:20.892 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:20.890+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:21.233 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:21.230+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:21.932 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:21.929+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:22.237 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:22.234+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:22.923 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:22.920+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:23.226 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:23.223+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:23.953 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:23.950+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:24.200 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:24.198+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:24.984 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:24.981+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:25.245 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:25.242+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:25.962 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:25.959+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:26.204 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:26.202+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:26.991 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:26.988+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:27.178 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:27.176+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:27.970 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:27.968+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:28.200 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:28.198+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:28.950 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:28.947+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:29.233 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:29.230+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:29.975 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:29.971+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:30.257 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:30.256+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:30.956 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:30.954+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:31.293 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:31.291+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:31.991 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:31.989+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:32.325 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:32.323+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:32.949 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:32.947+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:33.317 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:33.315+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:33.914 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:33.913+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:34.310 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:34.308+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:34.881 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:34.879+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:35.276 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:35.274+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:35.926 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:35.924+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:36.263 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:36.261+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:36.920 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:36.918+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:37.253 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:37.251+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:37.937 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:37.935+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:38.218 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:38.216+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:38.983 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:38.981+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:39.212 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:39.210+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:39.977 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:39.975+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:40.199 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:40.198+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:40.948 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:40.946+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:41.204 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:41.202+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:41.910 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:41.909+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:42.225 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:42.223+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:42.921 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:42.919+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:43.269 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:43.267+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:43.872 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:43.870+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:44.316 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:44.314+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:44.853 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:44.851+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:45.338 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:45.336+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:45.861 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:45.859+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:46.378 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:46.376+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:46.876 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:46.874+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:47.414 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:47.412+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:47.890 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:47.888+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:48.455 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:48.453+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:48.854 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:48.853+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:49.463 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:49.462+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:49.836 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:49.834+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:50.441 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:50.439+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:50.882 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:50.881+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:51.431 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:51.429+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:51.880 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:51.878+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:52.422 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:52.421+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:52.930 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:52.928+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:53.466 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:53.465+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:53.917 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:53.915+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:54.515 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:54.513+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:54.950 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:54.948+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:55.558 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:55.557+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:55.939 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:55.936+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:56.543 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:56.541+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:56.919 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:56.917+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:57.571 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:57.569+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:57.967 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:57.965+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:58.581 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:58.579+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:58.961 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:58.959+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:42:59.583 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:42:59.581+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:42:59.983 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:42:59.981+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:00.597 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:00.596+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:00.943 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:00.941+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:01.567 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:01.565+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:01.950 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:01.948+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:02.546 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:02.544+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:02.910 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:02.907+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:03.531 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:03.528+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:03.883 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:03.880+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:04.523 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:04.520+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:04.866 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:04.864+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:05.481 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:05.478+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:05.857 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:05.854+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:06.491 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:06.488+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:06.892 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:06.889+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:07.475 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:07.472+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:07.899 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:07.896+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:08.436 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:08.434+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:08.877 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:08.875+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:09.471 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:09.468+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:09.919 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:09.917+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:10.463 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:10.460+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:10.905 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:10.903+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:11.427 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:11.426+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:11.909 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:11.907+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:12.458 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:12.456+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:12.944 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:12.942+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:13.416 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:13.414+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:13.963 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:13.962+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:14.452 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:14.450+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:14.952 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:14.951+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:15.459 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:15.457+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:15.930 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:15.928+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:16.475 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:16.473+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:16.964 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:16.962+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:17.520 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:17.518+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:17.942 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:17.940+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:18.558 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:18.556+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:18.904 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:18.902+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:19.538 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:19.536+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:19.885 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:19.883+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:20.496 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:20.494+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:20.915 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:20.913+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:21.499 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:21.497+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:21.911 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:21.910+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:22.545 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:22.543+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:22.867 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:22.866+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:23.575 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:23.573+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:23.856 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:23.855+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:24.591 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:24.589+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:24.886 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:24.884+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:25.570 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:25.568+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:25.862 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:25.860+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:26.594 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:26.592+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:26.902 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:26.900+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:27.614 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:27.612+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:27.854 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:27.852+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:28.630 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:28.628+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:28.878 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:28.876+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:29.598 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:29.596+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:29.918 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:29.916+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:30.575 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:30.573+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:30.875 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:30.873+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:31.556 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:31.554+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:31.889 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:31.887+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:32.535 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:32.533+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:32.907 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:32.905+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:33.488 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:33.486+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:33.952 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:33.950+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:34.496 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:34.494+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:34.926 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:34.924+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:35.521 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:35.519+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:35.925 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:35.923+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:36.533 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:36.531+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:36.949 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:36.947+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:37.573 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:37.572+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:37.948 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:37.946+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:38.581 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:38.579+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:38.910 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:38.908+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:39.630 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:39.628+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:39.881 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:39.879+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:40.661 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:40.659+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:40.911 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:40.909+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:41.653 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:41.651+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:41.936 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:41.934+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:42.606 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:42.604+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:42.903 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:42.902+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:43.575 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:43.573+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:43.948 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:43.945+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:44.566 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:44.562+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:44.946 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:44.943+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:45.597 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:45.594+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:45.940 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:45.937+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:46.573 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:46.570+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:46.976 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:46.973+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:47.612 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:47.609+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:48.012 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:48.009+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:48.662 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:48.659+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:49.029 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:49.026+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:49.643 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:49.640+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:49.982 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:49.979+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:50.601 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:50.597+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:51.006 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:51.003+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:51.632 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:51.629+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:52.025 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:52.022+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:52.598 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:52.593+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:53.006 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:53.002+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:53.615 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:53.613+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:53.984 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:53.982+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:54.592 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:54.591+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:54.988 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:54.986+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:55.610 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:55.608+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:55.961 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:55.959+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:56.599 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:56.597+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:56.947 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:56.945+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:57.642 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:57.640+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:57.914 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:57.912+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:58.676 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:58.674+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:58.899 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:58.897+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:43:59.628 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:43:59.626+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:43:59.881 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:43:59.879+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:00.678 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:00.676+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:00.908 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:00.906+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:01.642 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:01.640+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:01.940 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:01.938+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:02.669 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:02.667+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:02.973 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:02.971+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:03.701 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:03.699+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:04.018 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:04.016+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:04.751 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:04.749+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:05.015 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:05.013+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:05.722 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:05.720+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:05.999 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:05.997+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:06.738 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:06.734+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:06.981 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:06.979+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:07.746 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:07.744+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:07.952 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:07.950+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:08.795 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:08.793+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:08.927 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:08.925+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:09.839 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:09.837+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:09.895 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:09.893+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:10.865 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:10.863+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:10.867 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:10.865+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:11.849 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:11.846+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:11.885 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:11.883+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:12.845 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:12.843+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:12.905 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:12.903+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:13.802 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:13.800+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:13.923 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:13.921+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:14.842 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:14.840+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:14.941 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:14.939+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:15.856 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:15.854+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:15.987 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:15.985+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:16.847 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:16.844+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:16.955 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:16.953+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:17.818 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:17.816+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:17.939 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:17.936+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:18.801 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:18.799+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:18.939 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:18.937+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:19.803 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:19.801+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:19.898 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:19.896+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:20.853 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:20.850+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:20.901 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:20.899+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:21.804 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:21.802+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:21.911 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:21.909+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:22.815 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:22.813+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:22.945 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:22.943+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:23.771 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:23.769+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:23.909 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:23.907+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:24.815 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:24.813+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:24.861 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:24.859+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:25.841 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:25.839+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:25.865 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:25.863+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:26.829 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:26.826+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:26.840 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:26.837+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:27.816 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:27.813+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:27.836 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:27.833+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:28.807 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:28.804+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:28.860 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:28.857+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:29.777 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:29.774+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:29.905 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:29.902+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:30.785 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:30.782+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:30.952 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:30.949+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:31.759 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:31.756+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:31.967 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:31.964+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:32.711 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:32.708+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:32.967 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:32.964+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:33.693 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:33.690+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:33.965 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:33.962+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:34.716 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:34.713+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:34.968 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:34.966+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:35.699 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:35.697+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:35.939 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:35.937+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:36.697 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:36.694+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:36.907 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:36.905+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:37.701 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:37.699+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:37.944 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:37.942+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:38.656 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:38.654+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:38.958 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:38.956+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:39.703 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:39.701+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:39.960 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:39.958+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:40.675 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:40.673+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:40.934 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:40.932+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:41.688 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:41.686+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:41.965 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:41.963+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:42.644 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:42.641+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:43.008 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:43.006+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:43.689 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:43.687+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:44.026 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:44.024+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:44.681 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:44.678+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:45.032 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:45.030+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:45.716 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:45.714+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:46.017 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:46.015+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:46.743 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:46.741+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:47.043 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:47.041+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:47.705 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:47.703+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:48.049 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:48.047+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:48.696 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:48.694+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:49.012 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:49.009+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:49.671 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:49.669+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:50.030 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:50.028+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:50.656 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:50.654+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:51.007 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:51.005+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:51.623 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:51.621+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:51.961 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:51.959+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:52.615 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:52.612+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:52.923 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:52.921+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:53.568 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:53.566+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:53.925 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:53.923+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:54.579 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:54.577+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:54.962 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:54.960+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:55.577 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:55.575+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:55.991 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:55.989+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:56.594 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:56.592+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:56.955 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:56.953+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:57.573 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:57.571+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:57.983 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:57.981+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:58.580 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:58.578+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:58.945 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:58.943+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:44:59.605 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:44:59.602+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:44:59.951 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:44:59.949+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:00.587 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:00.585+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:00.923 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:00.921+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:01.541 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:01.538+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:01.875 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:01.873+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:02.533 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:02.531+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:02.907 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:02.904+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:03.529 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:03.526+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:03.895 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:03.893+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:04.522 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:04.520+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:04.898 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:04.896+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:05.537 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:05.535+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:05.868 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:05.866+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:06.576 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:06.574+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:06.829 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:06.827+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:07.552 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:07.550+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:07.801 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:07.798+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:08.551 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:08.548+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:08.766 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:08.763+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:09.555 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:09.552+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:09.730 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:09.727+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:10.526 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:10.523+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:10.683 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:10.680+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:11.486 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:11.483+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:11.657 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:11.654+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:12.535 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:12.532+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:12.639 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:12.636+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:13.525 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:13.522+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:13.594 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:13.591+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:14.506 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:14.503+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:14.637 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:14.634+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:15.524 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:15.520+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:15.626 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:15.623+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:16.558 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:16.555+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:16.637 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:16.634+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:17.544 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:17.541+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:17.624 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:17.622+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:18.524 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:18.522+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:18.629 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:18.627+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:19.539 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:19.537+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:19.596 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:19.594+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:20.556 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:20.554+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:20.571 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:20.569+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:21.540 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:21.538+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:21.595 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:21.593+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:22.504 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:22.502+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:22.587 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:22.585+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:23.523 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:23.521+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:23.574 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:23.572+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:24.527 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:24.525+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:24.530 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:24.528+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:25.481 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:25.479+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:25.524 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:25.522+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:26.515 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:26.512+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:26.571 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:26.569+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:27.527 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:27.524+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:27.582 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:27.580+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:28.568 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:28.566+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:28.585 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:28.583+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:29.574 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:29.572+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:29.590 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:29.587+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:30.583 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:30.581+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:30.592 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:30.590+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:31.581 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:31.578+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:31.613 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:31.611+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:32.547 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:32.545+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:32.651 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:32.649+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:33.553 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:33.551+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:33.651 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:33.649+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:34.529 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:34.527+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:34.689 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:34.687+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:35.492 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:35.490+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:35.691 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:35.689+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:36.527 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:36.524+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:36.659 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:36.657+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:37.480 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:37.478+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:37.701 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:37.699+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:38.476 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:38.474+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:38.713 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:38.711+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:39.435 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:39.433+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:39.706 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:39.703+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:40.403 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:40.401+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:40.741 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:40.739+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:41.389 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:41.387+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:41.781 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:41.779+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:42.398 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:42.396+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:42.825 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:42.823+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:43.411 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:43.408+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:43.816 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:43.814+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:44.439 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:44.437+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:44.805 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:44.803+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:45.440 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:45.438+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:45.756 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:45.754+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:46.410 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:46.408+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:46.767 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:46.765+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:47.401 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:47.398+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:47.744 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:47.742+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:48.443 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:48.441+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:48.753 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:48.751+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:49.489 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:49.487+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:49.740 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:49.738+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:50.515 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:50.513+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:50.728 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:50.726+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:51.471 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:51.468+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:51.707 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:51.703+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:52.446 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:52.443+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:52.734 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:52.731+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:53.489 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:53.485+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:53.728 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:53.724+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:54.474 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:54.471+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:54.758 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:54.755+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:55.493 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:55.490+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:55.753 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:55.750+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:56.511 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:56.507+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:56.723 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:56.719+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:57.503 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:57.500+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:57.753 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:57.750+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:58.457 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:58.454+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:58.765 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:58.762+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:45:59.446 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:45:59.443+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:45:59.763 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:45:59.760+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:00.412 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:00.410+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:00.754 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:00.752+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:01.427 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:01.425+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:01.766 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:01.764+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:02.387 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:02.384+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:02.728 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:02.725+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:03.434 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:03.432+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:03.766 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:03.764+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:04.476 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:04.473+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:04.785 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:04.781+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:05.454 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:05.452+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:05.776 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:05.773+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:06.498 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:06.496+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:06.787 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:06.785+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:07.458 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:07.456+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:07.793 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:07.791+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:08.475 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:08.473+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:08.832 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:08.830+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:09.435 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:09.432+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:09.852 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:09.839+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:10.410 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:10.408+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:10.840 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:10.837+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:11.382 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:11.380+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:11.842 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:11.840+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:12.433 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:12.431+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:12.797 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:12.795+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:13.424 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:13.421+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:13.756 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:13.754+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:14.416 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:14.414+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:14.723 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:14.721+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:15.392 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:15.390+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:15.710 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:15.708+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:16.374 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:16.371+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:16.694 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:16.692+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:17.410 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:17.408+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:17.744 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:17.741+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:18.461 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:18.458+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:18.767 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:18.765+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:19.509 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:19.507+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:19.814 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:19.812+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:20.487 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:20.485+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:20.769 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:20.766+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:21.518 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:21.516+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:21.784 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:21.782+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:22.474 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:22.472+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:22.764 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:22.762+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:23.430 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:23.427+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:23.748 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:23.746+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:24.449 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:24.446+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:24.703 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:24.701+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:25.492 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:25.490+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:25.736 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:25.733+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:26.499 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:26.497+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:26.764 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:26.761+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:27.487 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:27.485+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:27.798 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:27.794+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:28.462 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:28.460+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:28.833 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:28.830+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:29.449 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:29.447+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:29.829 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:29.827+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:30.479 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:30.477+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:30.797 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:30.795+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:31.468 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:31.465+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:31.756 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:31.753+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:32.493 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:32.491+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:32.788 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:32.786+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:33.541 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:33.539+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:33.766 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:33.762+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:34.577 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:34.573+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:34.720 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:34.717+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:35.564 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:35.560+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:35.698 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:35.694+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:36.556 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:36.552+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:36.652 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:36.649+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:37.570 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:37.567+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:37.613 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:37.610+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:38.570 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:38.566+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:38.583 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:38.580+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:39.542 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:39.539+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:39.595 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:39.592+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:40.556 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:40.553+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:40.563 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:40.560+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:41.541 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:41.538+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:41.565 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:41.562+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:42.509 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:42.505+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:42.527 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:42.524+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:43.478 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:43.476+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:43.566 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:43.564+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:44.480 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:44.478+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:44.518 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:44.516+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:45.474 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:45.472+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:45.516 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:45.514+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:46.516 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:46.514+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:46.526 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:46.524+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:47.515 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:47.513+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:47.541 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:47.539+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:48.505 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:48.503+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:48.510 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:48.508+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:49.508 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:49.505+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:49.543 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:49.541+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:50.471 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:50.469+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:50.539 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:50.537+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:51.437 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:51.435+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:51.553 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:51.551+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:52.404 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:52.402+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:52.578 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:52.576+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:53.405 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:53.403+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:53.540 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:53.538+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:54.449 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:54.446+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:54.546 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:54.544+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:55.415 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:55.412+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:55.569 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:55.567+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:56.411 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:56.408+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:56.553 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:56.550+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:57.403 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:57.401+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:57.559 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:57.557+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:58.365 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:58.363+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:58.563 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:58.560+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:46:59.367 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:46:59.365+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:46:59.561 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:46:59.558+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:00.343 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:00.340+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:00.570 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:00.567+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:01.349 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:01.346+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:01.553 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:01.550+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:02.301 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:02.299+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:02.519 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:02.516+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:03.316 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:03.313+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:03.550 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:03.548+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:04.354 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:04.351+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:04.564 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:04.561+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:05.354 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:05.351+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:05.519 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:05.517+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:06.387 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:06.385+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:06.538 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:06.535+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:07.427 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:07.424+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:07.530 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:07.527+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:08.470 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:08.468+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:08.555 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:08.553+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:09.484 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:09.481+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:09.531 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:09.529+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:10.501 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:10.499+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:10.529 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:10.526+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:11.475 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:11.473+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:11.483 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:11.481+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:12.437 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:12.435+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:12.481 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:12.478+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:13.434 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:13.432+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:13.529 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:13.527+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:14.437 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:14.435+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:14.537 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:14.535+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:15.465 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:15.462+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:15.531 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:15.529+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:16.465 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:16.462+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:16.556 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:16.554+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:17.509 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:17.505+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:17.547 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:17.544+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:18.500 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:18.497+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:18.555 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:18.552+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:19.471 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:19.468+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:19.524 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:19.520+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:20.464 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:20.460+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:20.543 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:20.540+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:21.443 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:21.439+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:21.569 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:21.566+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:22.470 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:22.467+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:22.603 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:22.600+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:23.500 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:23.497+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:23.590 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:23.586+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:24.540 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:24.536+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:24.547 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:24.544+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:25.509 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:25.505+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:25.594 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:25.590+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:26.510 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:26.507+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:26.545 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:26.542+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:27.500 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:27.498+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:27.582 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:27.580+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:28.537 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:28.535+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:28.576 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:28.574+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:29.491 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:29.489+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:29.532 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:29.530+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:30.492 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:30.490+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:30.495 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:30.493+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:31.464 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:31.462+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:31.524 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:31.521+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:32.424 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:32.422+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:32.559 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:32.557+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:33.412 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:33.410+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:33.588 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:33.586+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:34.430 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:34.428+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:34.638 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:34.636+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:35.396 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:35.394+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:35.612 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:35.610+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:36.375 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:36.372+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:36.634 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:36.632+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:37.342 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:37.340+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:37.664 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:37.662+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:38.345 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:38.342+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:38.699 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:38.697+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:39.384 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:39.381+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:39.699 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:39.697+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:40.403 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:40.400+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:40.673 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:40.670+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:41.442 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:41.440+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:41.654 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:41.652+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:42.478 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:42.475+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:42.698 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:42.696+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:43.487 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:43.485+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:43.678 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:43.676+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:44.538 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:44.535+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:44.705 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:44.703+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:45.494 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:45.492+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:45.734 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:45.731+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:46.490 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:46.488+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:46.688 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:46.685+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:47.500 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:47.498+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:47.688 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:47.686+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:48.510 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:48.508+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:48.702 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:48.699+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:49.468 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:49.465+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:49.704 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:49.702+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:50.507 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:50.505+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:50.704 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:50.702+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:51.461 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:51.459+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:51.732 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:51.729+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:52.467 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:52.465+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:52.770 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:52.768+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:53.514 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:53.512+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:53.723 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:53.721+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:54.544 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:54.542+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:54.770 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:54.768+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:55.512 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:55.510+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:55.800 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:55.798+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:56.489 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:56.487+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:56.794 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:56.791+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:57.532 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:57.529+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:57.797 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:57.794+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:58.559 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:58.557+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:58.753 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:58.751+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:47:59.542 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:47:59.538+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:47:59.726 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:47:59.723+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:00.540 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:00.537+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:00.724 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:00.721+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:01.533 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:01.530+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:01.764 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:01.760+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:02.549 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:02.545+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:02.770 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:02.766+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:03.507 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:03.503+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:03.789 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:03.786+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:04.504 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:04.501+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:04.818 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:04.815+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:05.554 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:05.551+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:05.789 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:05.786+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:06.555 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:06.552+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:06.757 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:06.753+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:07.519 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:07.516+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:07.781 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:07.778+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:08.478 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:08.475+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:08.771 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:08.767+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:09.450 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:09.447+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:09.799 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:09.797+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:10.417 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:10.415+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:10.848 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:10.845+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:11.426 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:11.423+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:11.869 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:11.867+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:12.474 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:12.472+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:12.877 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:12.875+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:13.488 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:13.485+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:13.912 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:13.909+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:14.459 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:14.457+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:14.961 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:14.959+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:15.413 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:15.411+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:15.950 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:15.948+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:16.409 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:16.407+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:16.933 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:16.930+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:17.387 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:17.385+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:17.933 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:17.930+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:18.402 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:18.400+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:18.976 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:18.974+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:19.440 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:19.437+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:19.956 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:19.953+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:20.487 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:20.484+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:20.969 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:20.967+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:21.474 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:21.471+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:21.967 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:21.965+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:22.427 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:22.425+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:22.949 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:22.947+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:23.469 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:23.466+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:23.949 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:23.947+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:24.427 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:24.424+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:24.911 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:24.909+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:25.471 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:25.469+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:25.903 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:25.900+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:26.489 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:26.486+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:26.941 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:26.939+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:27.468 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:27.465+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:27.899 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:27.896+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:28.490 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:28.488+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:28.924 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:28.921+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:29.513 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:29.510+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:29.917 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:29.914+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:30.508 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:30.506+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:30.931 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:30.929+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:31.535 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:31.533+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:31.889 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:31.887+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:32.539 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:32.537+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:32.933 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:32.931+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:33.539 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:33.537+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:33.899 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:33.897+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:34.570 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:34.568+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:34.873 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:34.871+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:35.617 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:35.615+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:35.841 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:35.838+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:36.667 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:36.664+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:36.800 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:36.797+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:37.658 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:37.655+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:37.757 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:37.755+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:38.701 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:38.699+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:38.715 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:38.713+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:39.711 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:39.709+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:39.715 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:39.713+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:40.688 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:40.686+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:40.740 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:40.738+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:41.647 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:41.645+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:41.758 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:41.756+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:42.609 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:42.606+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:42.781 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:42.777+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:43.615 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:43.612+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:43.819 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:43.816+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:44.603 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:44.600+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:44.845 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:44.842+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:45.589 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:45.585+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:45.798 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:45.794+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:46.598 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:46.594+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:46.786 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:46.782+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:47.615 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:47.612+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:47.747 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:47.744+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:48.601 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:48.597+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:48.711 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:48.708+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:49.633 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:49.630+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:49.680 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:49.676+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:50.596 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:50.593+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:50.718 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:50.716+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:51.629 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:51.627+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:51.695 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:51.692+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:52.672 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:52.669+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:52.700 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:52.698+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:53.625 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:53.623+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:53.750 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:53.748+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:54.632 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:54.630+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:54.776 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:54.774+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:55.584 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:55.582+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:55.744 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:55.742+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:56.624 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:56.621+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:56.781 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:56.778+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:57.663 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:57.660+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:57.747 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:57.745+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:58.701 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:58.699+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:48:58.712 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:58.710+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:59.732 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:48:59.730+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:48:59.752 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:48:59.750+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:00.730 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:00.727+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:00.758 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:00.755+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:01.730 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:01.728+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:01.771 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:01.768+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:02.728 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:02.725+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:02.795 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:02.793+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:03.713 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:03.711+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:03.761 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:03.757+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:04.740 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:04.738+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:04.790 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:04.787+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:05.787 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:05.785+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:05.808 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:05.805+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:06.751 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:06.748+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:06.771 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:06.768+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:07.702 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:07.699+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:07.762 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:07.760+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:08.747 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:08.744+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:08.794 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:08.791+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:09.724 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:09.721+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:09.828 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:09.826+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:10.704 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:10.702+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:10.833 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:10.830+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:11.684 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:11.682+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:11.838 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:11.836+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:12.707 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:12.704+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:12.886 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:12.884+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:13.737 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:13.735+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:13.917 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:13.914+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:14.754 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:14.752+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:14.916 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:14.914+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:15.741 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:15.738+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:15.950 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:15.948+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:16.746 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:16.743+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:16.913 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:16.911+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:17.712 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:17.710+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:17.923 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:17.921+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:18.717 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:18.714+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:18.964 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:18.962+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:19.744 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:19.742+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:19.934 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:19.932+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:20.707 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:20.705+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:20.908 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:20.906+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:21.717 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:21.714+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:21.910 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:21.908+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:22.763 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:22.761+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:22.938 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:22.936+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:23.804 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:23.801+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:23.892 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:23.890+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:24.773 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:24.771+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:24.923 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:24.921+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:25.773 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:25.769+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:25.952 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:25.948+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:26.791 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:26.787+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:26.948 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:26.944+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:27.798 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:27.795+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:27.954 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:27.951+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:28.779 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:28.775+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:28.984 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:28.980+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:29.746 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:29.743+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:29.950 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:29.947+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:30.753 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:30.749+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:30.979 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:30.976+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:31.732 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:31.729+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:31.956 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:31.953+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:32.776 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:32.773+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:32.914 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:32.911+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:33.816 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:33.812+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:33.908 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:33.905+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:34.771 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:34.768+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:34.899 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:34.896+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:35.778 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:35.776+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:35.900 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:35.898+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:36.821 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:36.819+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:36.896 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:36.894+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:37.786 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:37.783+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:37.929 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:37.926+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:38.769 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:38.766+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:38.902 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:38.900+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:39.757 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:39.754+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:39.866 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:39.863+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:40.724 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:40.721+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:40.853 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:40.850+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:41.821 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:41.755+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:41.895 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:41.893+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:42.766 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:42.763+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:42.883 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:42.881+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:43.748 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:43.746+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:43.847 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:43.845+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:44.744 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:44.742+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:44.812 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:44.810+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:45.702 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:45.700+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:45.791 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:45.788+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:46.727 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:46.725+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:46.742 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:46.740+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:47.722 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:47.719+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:47.774 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:47.772+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:48.699 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:48.696+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:48.821 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:48.819+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:49.714 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:49.711+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:49.792 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:49.789+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:50.740 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:50.738+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:50.753 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:50.751+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:51.747 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:51.744+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:51.803 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:51.800+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:52.784 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:52.781+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:52.851 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:52.848+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:53.798 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:53.795+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:53.833 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:53.831+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:54.804 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:54.802+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:54.828 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:54.825+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:55.815 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:55.813+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:55.818 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:55.815+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:56.771 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:56.768+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:56.823 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:56.820+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:57.764 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:57.761+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:57.856 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:57.853+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:58.720 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:58.718+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:58.836 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:58.834+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:49:59.751 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:49:59.748+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:49:59.873 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:49:59.870+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:00.704 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:00.702+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:00.872 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:00.870+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:01.662 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:01.660+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:01.889 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:01.887+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:02.665 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:02.662+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:02.938 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:02.935+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:03.636 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:03.634+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:03.918 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:03.916+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:04.652 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:04.650+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:04.907 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:04.904+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:05.610 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:05.606+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:05.881 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:05.879+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:06.624 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:06.622+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:06.924 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:06.921+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:07.611 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:07.609+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:07.941 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:07.938+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:08.647 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:08.644+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:08.932 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:08.929+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:09.653 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:09.650+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:09.888 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:09.884+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:10.624 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:10.620+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:10.864 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:10.860+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:11.664 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:11.661+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:11.913 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:11.909+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:12.663 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:12.660+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:12.894 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:12.891+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:13.690 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:13.686+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:13.868 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:13.865+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:14.663 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:14.659+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:14.847 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:14.844+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:15.634 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:15.630+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:15.864 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:15.860+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:16.683 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:16.679+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:16.853 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:16.849+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:17.665 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:17.663+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:17.892 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:17.890+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:18.657 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:18.654+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:18.872 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:18.869+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:19.662 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:19.660+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:19.841 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:19.839+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:20.643 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:20.640+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:20.843 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:20.840+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:21.655 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:21.652+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:21.802 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:21.799+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:22.652 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:22.650+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:22.763 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:22.761+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:23.698 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:23.695+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:23.764 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:23.762+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:24.689 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:24.685+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:24.747 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:24.744+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:25.692 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:25.689+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:25.728 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:25.726+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:26.686 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:26.684+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:26.693 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:26.691+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:27.657 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:27.654+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:27.665 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:27.663+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:28.635 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:28.632+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:28.684 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:28.681+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:29.610 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:29.608+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:29.688 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:29.686+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:30.623 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:30.620+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:30.697 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:30.694+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:31.612 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:31.610+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:31.651 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:31.648+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:32.591 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:32.589+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:32.610 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:32.608+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:33.576 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:33.574+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:33.588 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:33.586+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:34.559 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:34.556+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:34.593 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:34.591+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:35.549 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:35.546+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:35.553 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:35.551+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:36.582 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:36.580+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:36.598 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:36.596+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:37.618 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:37.616+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:37.628 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:37.626+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:38.588 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:38.585+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:38.638 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:38.636+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:39.637 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:39.635+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:39.645 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:39.643+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:40.652 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:40.649+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:40.675 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:40.673+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:41.629 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:41.626+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:41.665 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:41.662+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:42.608 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:42.606+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:42.660 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:42.657+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:43.631 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:43.628+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:43.699 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:43.696+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:44.662 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:44.660+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:44.678 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:44.675+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:45.663 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:45.660+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:45.684 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:45.682+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:46.615 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:46.612+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:46.696 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:46.693+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:47.652 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:47.649+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:47.714 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:47.712+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:48.627 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:48.624+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:48.699 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:48.697+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:49.581 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:49.578+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:49.735 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:49.732+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:50.591 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:50.589+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:50.763 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:50.760+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:51.588 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:51.585+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:51.802 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:51.799+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:52.574 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:52.570+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:52.778 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:52.774+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:53.578 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:53.574+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:53.782 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:53.778+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:54.540 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:54.536+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:54.822 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:54.818+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:55.537 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:55.533+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:55.795 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:55.791+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:56.580 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:56.576+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:56.782 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:56.779+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:57.542 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:57.539+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:57.796 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:57.793+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:58.567 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:58.563+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:58.843 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:58.839+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:50:59.580 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:50:59.576+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:50:59.876 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:50:59.872+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:00.594 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:00.591+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:00.886 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:00.883+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:01.577 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:01.574+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:01.904 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:01.901+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:02.561 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:02.559+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:02.859 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:02.856+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:03.524 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:03.521+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:03.907 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:03.905+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:04.563 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:04.561+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:04.940 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:04.937+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:05.556 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:05.553+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:05.967 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:05.965+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:06.553 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:06.550+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:07.007 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:07.004+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:07.512 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:07.509+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:07.988 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:07.986+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:08.500 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:08.497+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:08.962 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:08.959+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:09.490 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:09.487+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:09.936 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:09.934+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:10.511 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:10.509+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:10.957 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:10.954+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:11.552 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:11.549+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:11.920 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:11.918+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:12.508 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:12.504+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:12.923 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:12.920+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:13.505 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:13.502+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:13.892 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:13.889+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:14.519 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:14.516+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:14.869 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:14.866+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:15.523 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:15.520+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:15.825 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:15.823+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:16.505 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:16.502+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:16.776 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:16.774+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:17.478 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:17.475+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:17.769 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:17.766+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:18.506 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:18.504+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:18.807 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:18.805+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:19.529 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:19.527+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:19.772 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:19.769+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:20.546 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:20.544+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:20.758 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:20.756+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:21.534 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:21.532+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:21.712 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:21.709+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:22.569 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:22.567+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:22.759 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:22.756+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:23.579 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:23.576+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:23.762 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:23.759+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:24.566 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:24.563+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:24.808 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:24.805+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:25.521 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:25.518+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:25.774 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:25.772+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:26.552 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:26.549+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:26.738 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:26.736+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:27.570 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:27.567+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:27.758 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:27.755+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:28.542 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:28.539+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:28.717 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:28.715+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:29.501 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:29.498+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:29.719 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:29.716+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:30.505 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:30.502+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:30.765 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:30.762+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:31.553 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:31.550+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:31.762 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:31.759+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:32.564 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:32.562+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:32.715 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:32.713+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:33.608 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:33.605+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:33.755 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:33.752+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:34.591 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:34.588+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:34.765 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:34.761+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:35.591 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:35.587+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:35.767 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:35.763+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:36.587 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:36.583+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:36.803 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:36.800+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:37.575 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:37.571+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:37.807 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:37.803+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:38.570 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:38.566+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:38.782 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:38.778+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:39.564 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:39.561+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:39.782 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:39.778+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:40.602 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:40.598+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:40.807 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:40.803+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:41.649 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:41.646+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:41.801 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:41.797+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:42.684 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:42.680+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:42.828 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:42.825+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:43.702 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:43.699+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:43.827 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:43.823+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:44.671 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:44.668+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:44.821 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:44.818+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:45.688 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:45.685+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:45.861 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:45.856+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:46.715 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:46.712+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:46.869 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:46.867+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:47.691 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:47.688+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:47.906 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:47.904+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:48.681 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:48.679+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:48.893 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:48.888+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:49.644 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:49.642+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:49.937 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:49.934+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:50.691 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:50.689+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:50.959 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:50.956+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:51.660 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:51.657+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:51.957 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:51.955+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:52.616 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:52.614+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:52.974 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:52.971+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:53.661 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:53.659+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:53.982 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:53.980+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:54.648 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:54.646+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:55.021 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:55.019+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:55.664 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:55.661+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:55.988 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:55.986+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:56.701 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:56.699+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:56.983 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:56.980+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:57.746 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:57.743+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:58.021 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:58.018+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:58.733 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:58.730+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:51:59.036 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:51:59.034+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:51:59.712 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:51:59.709+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:00.086 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:00.084+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:00.668 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:00.665+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:01.131 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:01.129+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:01.718 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:01.716+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:02.149 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:02.146+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:02.739 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:02.736+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:03.123 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:03.120+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:03.781 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:03.778+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:04.118 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:04.115+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:04.735 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:04.732+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:05.098 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:05.095+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:05.723 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:05.720+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:06.066 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:06.064+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:06.677 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:06.674+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:07.082 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:07.080+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:07.650 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:07.648+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:08.057 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:08.055+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:08.613 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:08.610+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:09.019 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:09.017+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:09.593 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:09.591+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:10.041 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:10.038+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:10.644 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:10.641+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:10.995 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:10.993+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:11.620 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:11.617+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:12.015 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:12.012+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:12.589 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:12.587+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:13.044 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:13.042+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:13.549 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:13.547+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:14.054 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:14.052+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:14.517 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:14.515+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:15.023 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:15.021+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:15.538 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:15.535+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:16.031 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:16.028+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:16.526 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:16.523+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:17.049 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:17.045+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:17.482 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:17.479+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:18.014 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:18.010+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:18.526 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:18.522+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:18.973 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:18.969+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:19.555 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:19.551+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:20.007 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:20.004+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:20.556 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:20.553+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:21.018 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:21.014+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:21.534 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:21.530+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:21.996 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:21.993+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:22.542 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:22.538+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:23.000 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:22.996+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:23.539 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:23.535+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:23.982 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:23.978+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:24.495 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:24.491+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:25.003 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:24.999+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:25.509 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:25.506+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:26.050 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:26.046+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:26.540 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:26.537+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:27.089 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:27.087+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:27.551 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:27.548+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:28.040 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:28.038+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:28.548 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:28.546+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:29.062 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:29.059+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:29.504 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:29.502+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:30.017 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:30.014+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:30.520 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:30.517+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:31.000 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:30.997+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:31.515 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:31.513+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:32.024 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:32.022+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:32.476 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:32.474+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:32.992 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:32.989+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:33.450 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:33.448+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:34.029 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:34.026+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:34.492 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:34.489+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:35.064 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:35.062+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:35.449 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:35.447+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:36.085 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:36.081+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:36.407 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:36.405+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:37.074 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:37.072+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:37.429 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:37.426+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:38.050 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:38.047+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:38.397 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:38.394+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:39.068 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:39.066+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:39.368 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:39.365+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:40.050 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:40.047+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:40.352 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:40.349+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:41.041 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:41.038+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:41.313 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:41.310+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:42.041 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:42.039+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:42.302 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:42.300+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:43.040 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:43.037+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:43.270 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:43.267+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:44.015 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:44.012+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:44.294 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:44.291+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:45.017 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:45.015+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:45.308 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:45.305+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:45.987 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:45.985+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:46.331 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:46.329+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:47.028 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:47.025+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:47.322 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:47.319+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:48.067 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:48.064+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:48.329 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:48.326+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:49.062 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:49.059+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:49.318 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:49.315+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:50.087 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:50.085+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:50.328 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:50.325+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:51.121 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:51.118+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:51.320 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:51.317+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:52.115 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:52.112+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:52.346 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:52.343+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:53.153 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:53.150+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:53.326 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:53.323+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:54.191 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:54.188+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:54.326 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:54.323+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:55.197 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:55.195+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:55.353 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:55.350+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:56.183 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:56.181+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:56.309 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:56.306+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:57.183 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:57.181+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:57.277 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:57.274+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:58.149 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:58.146+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:58.229 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:58.226+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:52:59.177 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:52:59.174+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:52:59.234 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:52:59.231+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:00.222 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:00.218+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:00.225 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:00.221+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:01.172 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:01.169+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:01.229 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:01.225+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:02.163 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:02.160+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:02.184 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:02.180+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:03.189 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:03.185+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:03.197 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:03.193+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:04.152 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:04.149+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:04.154 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:04.150+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:05.105 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:05.102+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:05.188 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:05.184+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:06.080 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:06.076+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:06.169 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:06.166+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:07.114 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:07.110+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:07.213 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:07.209+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:08.121 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:08.118+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:08.207 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:08.203+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:09.138 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:09.136+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:09.209 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:09.206+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:10.106 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:10.103+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:10.250 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:10.247+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:11.116 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:11.114+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:11.288 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:11.285+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:12.097 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:12.095+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:12.310 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:12.307+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:13.126 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:13.123+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:13.351 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:13.349+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:14.169 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:14.166+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:14.309 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:14.307+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:15.190 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:15.187+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:15.328 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:15.326+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:16.183 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:16.180+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:16.281 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:16.279+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:17.184 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:17.181+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:17.284 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:17.281+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:18.173 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:18.170+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:18.254 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:18.251+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:19.218 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:19.215+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:19.292 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:19.289+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:20.239 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:20.236+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:20.339 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:20.336+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:21.238 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:21.235+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:21.331 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:21.328+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:22.263 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:22.260+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:22.322 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:22.319+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:23.292 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:23.288+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:23.308 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:23.305+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:24.285 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:24.281+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:24.340 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:24.337+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:25.243 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:25.241+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:25.327 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:25.324+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:26.234 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:26.231+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:26.372 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:26.369+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:27.265 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:27.263+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:27.348 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:27.345+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:28.269 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:28.267+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:28.377 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:28.374+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:29.252 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:29.249+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:29.328 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:29.325+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:30.221 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:30.218+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:30.336 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:30.333+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:31.236 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:31.233+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:31.308 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:31.305+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:32.248 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:32.246+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:32.306 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:32.303+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:33.236 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:33.233+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:33.269 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:33.266+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:34.219 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:34.216+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:34.254 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:34.252+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:35.228 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:35.225+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:35.259 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:35.256+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:36.229 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:36.226+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:36.276 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:36.273+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:37.217 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:37.215+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:37.315 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:37.313+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:38.219 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:38.216+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:38.286 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:38.283+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:39.221 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:39.218+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:39.319 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:39.317+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:40.246 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:40.243+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:40.362 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:40.359+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:41.242 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:41.239+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:41.359 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:41.356+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:42.238 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:42.235+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:42.350 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:42.348+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:43.219 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:43.216+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:43.350 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:43.346+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:44.208 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:44.204+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:44.327 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:44.324+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:45.215 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:45.211+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:45.286 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:45.282+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:46.190 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:46.187+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:46.249 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:46.246+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:47.178 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:47.174+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:47.229 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:47.226+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:48.154 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:48.151+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:48.188 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:48.184+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:49.171 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:49.167+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:49.236 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:49.232+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:50.185 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:50.181+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:50.261 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:50.258+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:51.179 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:51.175+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:51.300 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:51.296+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:52.148 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:52.145+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:52.312 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:52.309+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:53.101 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:53.098+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:53.315 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:53.312+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:54.054 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:54.051+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:54.330 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:54.327+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:55.069 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:55.066+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:55.297 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:55.294+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:56.060 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:56.057+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:56.344 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:56.341+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:57.108 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:57.105+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:57.384 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:57.381+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:58.111 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:58.109+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:58.420 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:58.418+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:53:59.131 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:53:59.129+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:53:59.464 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:53:59.462+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:00.083 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:00.081+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:00.471 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:00.468+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:01.103 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:01.100+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:01.448 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:01.446+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:02.079 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:02.076+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:02.409 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:02.406+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:03.092 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:03.090+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:03.411 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:03.408+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:04.101 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:04.098+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:04.369 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:04.366+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:05.088 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:05.085+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:05.375 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:05.372+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:06.126 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:06.124+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:06.397 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:06.394+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:07.130 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:07.124+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:07.370 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:07.367+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:08.109 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:08.106+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:08.341 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:08.339+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:09.158 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:09.155+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:09.328 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:09.324+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:10.153 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:10.151+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:10.296 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:10.293+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:11.192 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:11.190+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:11.282 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:11.279+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:12.170 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:12.167+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:12.309 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:12.306+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:13.129 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:13.126+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:13.328 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:13.325+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:14.126 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:14.124+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:14.318 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:14.314+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:15.144 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:15.141+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:15.297 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:15.294+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:16.097 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:16.094+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:16.275 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:16.273+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:17.143 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:17.140+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:17.257 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:17.254+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:18.097 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:18.094+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:18.245 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:18.242+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:19.130 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:19.127+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:19.203 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:19.201+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:20.161 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:20.158+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:20.164 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:20.161+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:21.128 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:21.126+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:21.183 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:21.180+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:22.178 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:22.175+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:22.185 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:22.183+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:23.165 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:23.160+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:23.212 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:23.210+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:24.192 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:24.190+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:24.202 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:24.199+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:25.178 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:25.175+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:25.196 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:25.194+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:26.215 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:26.211+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:26.226 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:26.222+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:27.176 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:27.172+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:27.239 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:27.236+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:28.211 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:28.207+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:28.279 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:28.275+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:29.190 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:29.187+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:29.286 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:29.282+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:30.194 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:30.190+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:30.318 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:30.314+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:31.226 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:31.223+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:31.284 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:31.280+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:32.202 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:32.199+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:32.289 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:32.285+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:33.176 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:33.172+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:33.295 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:33.291+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:34.179 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:34.175+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:34.248 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:34.244+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:35.199 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:35.197+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:35.226 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:35.223+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:36.155 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:36.152+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:36.188 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:36.185+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:37.149 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:37.146+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:37.150 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:37.147+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:38.114 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:38.112+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:38.168 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:38.165+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:39.122 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:39.119+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:39.160 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:39.158+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:40.150 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:40.148+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:40.154 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:40.152+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:41.159 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:41.156+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:41.179 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:41.176+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:42.143 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:42.141+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:42.165 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:42.163+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:43.111 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:43.108+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:43.133 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:43.130+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:44.117 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:44.114+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:44.145 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:44.143+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:45.115 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:45.112+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:45.143 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:45.141+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:46.080 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:46.077+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:46.150 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:46.147+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:47.076 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:47.073+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:47.147 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:47.145+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:48.063 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:48.060+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:48.191 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:48.188+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:49.079 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:49.077+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:49.198 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:49.195+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:50.092 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:50.089+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:50.176 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:50.173+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:51.044 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:51.041+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:51.184 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:51.181+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:52.088 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:52.086+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:52.191 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:52.188+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:53.115 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:53.112+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:53.169 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:53.166+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:54.145 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:54.143+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:54.169 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:54.166+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:55.169 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:55.166+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:55.209 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:55.207+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:56.150 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:56.147+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:56.236 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:56.233+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:57.186 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:57.183+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:57.223 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:57.220+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:58.142 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:58.139+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:58.258 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:58.256+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:54:59.095 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:54:59.092+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:54:59.277 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:54:59.274+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:00.050 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:00.047+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:00.268 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:00.265+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:01.050 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:01.046+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:01.237 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:01.234+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:02.025 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:02.022+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:02.260 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:02.257+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:03.068 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:03.066+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:03.286 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:03.283+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:04.034 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:04.031+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:04.260 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:04.257+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:05.055 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:05.052+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:05.271 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:05.268+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:06.082 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:06.079+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:06.236 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:06.233+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:07.087 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:07.084+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:07.243 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:07.240+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:08.087 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:08.084+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:08.274 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:08.270+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:09.056 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:09.052+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:09.315 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:09.311+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:10.044 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:10.040+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:10.331 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:10.327+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:11.025 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:11.021+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:11.355 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:11.351+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:12.049 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:12.046+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:12.339 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:12.335+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:13.068 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:13.064+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:13.331 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:13.327+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:14.074 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:14.070+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:14.358 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:14.354+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:15.062 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:15.059+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:15.309 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:15.305+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:16.085 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:16.081+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:16.357 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:16.353+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:17.124 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:17.120+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:17.361 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:17.358+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:18.166 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:18.163+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:18.360 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:18.357+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:19.173 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:19.170+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:19.348 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:19.345+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:20.176 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:20.173+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:20.330 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:20.327+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:21.175 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:21.172+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:21.295 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:21.292+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:22.151 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:22.148+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:22.304 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:22.302+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:23.157 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:23.155+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:23.277 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:23.274+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:24.139 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:24.136+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:24.241 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:24.238+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:25.184 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:25.181+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:25.255 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:25.252+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:26.186 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:26.183+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:26.235 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:26.232+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:27.199 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:27.196+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:27.213 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:27.210+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:28.199 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:28.196+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:28.203 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:28.200+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:29.206 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:29.203+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:29.231 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:29.228+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:30.189 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:30.186+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:30.231 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:30.228+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:31.214 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:31.211+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:31.232 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:31.229+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:32.165 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:32.162+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:32.251 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:32.248+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:33.155 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:33.152+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:33.258 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:33.255+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:34.181 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:34.178+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:34.248 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:34.245+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:35.188 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:35.186+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:35.255 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:35.252+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:36.155 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:36.152+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:36.222 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:36.220+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:37.154 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:37.151+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:37.191 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:37.189+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:38.127 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:38.124+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:38.180 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:38.178+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:39.110 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:39.108+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:39.196 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:39.193+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:40.104 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:40.101+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:40.224 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:40.222+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:41.082 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:41.080+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:41.241 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:41.238+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:42.127 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:42.124+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:42.266 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:42.263+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:43.093 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:43.090+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:43.265 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:43.262+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:44.094 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:44.092+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:44.277 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:44.274+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:45.062 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:45.058+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:45.264 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:45.262+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:46.054 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:46.051+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:46.229 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:46.226+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:47.102 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:47.100+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:47.217 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:47.214+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:48.114 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:48.112+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:48.235 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:48.232+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:49.134 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:49.131+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:49.230 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:49.227+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:50.150 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:50.147+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:50.203 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:50.200+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:51.118 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:51.114+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:51.183 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:51.179+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:52.087 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:52.083+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:52.158 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:52.155+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:53.068 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:53.064+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:53.201 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:53.197+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:54.086 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:54.082+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:54.186 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:54.182+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:55.075 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:55.071+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:55.154 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:55.150+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:56.058 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:56.054+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:56.204 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:56.200+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:57.088 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:57.084+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:57.252 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:57.248+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:58.096 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:58.093+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:58.286 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:58.282+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:55:59.147 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:55:59.143+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:55:59.318 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:55:59.314+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:00.190 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:00.186+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:00.366 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:00.363+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:01.225 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:01.223+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:01.327 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:01.324+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:02.211 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:02.208+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:02.333 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:02.330+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:03.213 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:03.210+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:03.360 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:03.357+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:04.209 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:04.206+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:04.342 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:04.339+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:05.191 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:05.188+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:05.306 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:05.303+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:06.173 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:06.167+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:06.269 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:06.266+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:07.151 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:07.149+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:07.230 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:07.227+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:08.182 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:08.180+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:08.197 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:08.195+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:09.221 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:09.219+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:09.233 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:09.231+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:10.226 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:10.223+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:10.277 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:10.275+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:11.196 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:11.193+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:11.295 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:11.293+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:12.168 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:12.165+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:12.299 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:12.296+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:13.172 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:13.169+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:13.348 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:13.345+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:14.181 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:14.178+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:14.346 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:14.343+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:15.211 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:15.208+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:15.392 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:15.389+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:16.258 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:16.255+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:16.414 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:16.411+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:17.226 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:17.223+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:17.423 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:17.421+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:18.256 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:18.254+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:18.380 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:18.377+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:19.216 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:19.213+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:19.370 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:19.367+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:20.262 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:20.259+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:20.326 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:20.323+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:21.308 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:21.305+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:21.371 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:21.368+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:22.319 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:22.317+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:22.360 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:22.357+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:23.313 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:23.310+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:23.400 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:23.397+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:24.285 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:24.282+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:24.442 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:24.439+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:25.278 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:25.275+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:25.428 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:25.425+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:26.328 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:26.325+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:26.456 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:26.453+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:27.315 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:27.312+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:27.426 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:27.423+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:28.287 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:28.284+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:28.408 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:28.405+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:29.282 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:29.280+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:29.411 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:29.408+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:30.236 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:30.233+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:30.453 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:30.450+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:31.231 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:31.228+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:31.435 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:31.433+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:32.231 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:32.228+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:32.402 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:32.399+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:33.193 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:33.190+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:33.451 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:33.448+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:34.151 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:34.147+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:34.484 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:34.480+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:35.187 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:35.183+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:35.437 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:35.433+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:36.180 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:36.176+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:36.462 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:36.458+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:37.187 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:37.184+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:37.479 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:37.475+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:38.233 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:38.229+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:38.458 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:38.455+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:39.234 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:39.230+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:39.447 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:39.443+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:40.209 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:40.205+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:40.433 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:40.430+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:41.218 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:41.214+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:41.435 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:41.431+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:42.236 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:42.233+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:42.478 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:42.474+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:43.231 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:43.228+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:43.503 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:43.501+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:44.282 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:44.279+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:44.546 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:44.543+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:45.267 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:45.264+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:45.566 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:45.563+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:46.257 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:46.254+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:46.555 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:46.552+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:47.213 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:47.210+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:47.596 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:47.593+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:48.218 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:48.215+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:48.575 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:48.572+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:49.251 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:49.248+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:49.610 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:49.607+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:50.203 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:50.200+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:50.604 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:50.602+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:51.192 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:51.189+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:51.621 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:51.618+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:52.177 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:52.174+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:52.594 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:52.591+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:53.225 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:53.222+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:53.605 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:53.602+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:54.248 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:54.246+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:54.614 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:54.611+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:55.257 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:55.254+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:55.590 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:55.587+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:56.215 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:56.212+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:56.628 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:56.625+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:57.214 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:57.211+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:57.626 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:57.623+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:58.180 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:58.177+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:58.652 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:58.649+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:56:59.195 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:56:59.192+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:56:59.628 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:56:59.625+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:00.153 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:00.150+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:00.668 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:00.665+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:01.203 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:01.200+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:01.672 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:01.669+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:02.228 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:02.225+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:02.663 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:02.660+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:03.223 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:03.220+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:03.631 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:03.628+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:04.233 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:04.230+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:04.590 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:04.588+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:05.262 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:05.259+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:05.612 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:05.609+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:06.311 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:06.308+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:06.606 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:06.603+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:07.321 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:07.318+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:07.597 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:07.594+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:08.275 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:08.272+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:08.614 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:08.611+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:09.257 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:09.254+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:09.578 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:09.576+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:10.241 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:10.238+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:10.594 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:10.591+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:11.235 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:11.232+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:11.632 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:11.630+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:12.285 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:12.282+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:12.671 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:12.668+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:13.318 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:13.315+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:13.672 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:13.669+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:14.279 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:14.276+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:14.679 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:14.676+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:15.252 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:15.249+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:15.656 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:15.653+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:16.301 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:16.298+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:16.678 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:16.675+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:17.321 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:17.317+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:17.673 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:17.669+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:18.326 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:18.322+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:18.649 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:18.646+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:19.286 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:19.283+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:19.607 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:19.603+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:20.257 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:20.253+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:20.654 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:20.650+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:21.275 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:21.271+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:21.628 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:21.624+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:22.306 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:22.302+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:22.588 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:22.584+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:23.311 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:23.307+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:23.638 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:23.634+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:24.356 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:24.352+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:24.642 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:24.638+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:25.398 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:25.394+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:25.606 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:25.602+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:26.383 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:26.380+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:26.586 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:26.583+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:27.373 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:27.370+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:27.587 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:27.584+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:28.413 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:28.410+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:28.632 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:28.629+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:29.461 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:29.458+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:29.645 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:29.642+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:30.489 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:30.486+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:30.620 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:30.617+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:31.484 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:31.481+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:31.585 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:31.582+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:32.436 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:32.433+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:32.611 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:32.608+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:33.465 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:33.462+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:33.618 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:33.616+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:34.515 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:34.512+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:34.648 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:34.645+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:35.550 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:35.547+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:35.619 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:35.616+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:36.508 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:36.505+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:36.614 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:36.611+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:37.518 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:37.515+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:37.612 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:37.609+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:38.555 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:38.552+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:38.577 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:38.574+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:39.526 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:39.523+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:39.566 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:39.563+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:40.521 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:40.518+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:40.534 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:40.532+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:41.520 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:41.517+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:41.524 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:41.521+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:42.491 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:42.488+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:42.504 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:42.501+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:43.518 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:43.516+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:43.526 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:43.523+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:44.524 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:44.521+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:44.536 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:44.533+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:45.510 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:45.507+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:45.542 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:45.539+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:46.557 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:46.555+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:46.562 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:46.560+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:47.533 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:47.530+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:47.558 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:47.555+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:48.510 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:48.508+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:48.539 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:48.536+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:49.479 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:49.476+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:49.584 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:49.581+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:50.511 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:50.508+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:50.564 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:50.561+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:51.511 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:51.508+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:51.601 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:51.598+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:52.501 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:52.498+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:52.582 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:52.580+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:53.475 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:53.472+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:53.591 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:53.588+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:54.464 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:54.461+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:54.584 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:54.581+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:55.428 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:55.425+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:55.628 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:55.625+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:56.388 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:56.385+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:56.673 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:56.670+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:57.400 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:57.397+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:57.667 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:57.664+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:58.388 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:58.385+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:58.620 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:58.617+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:57:59.340 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:57:59.336+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:57:59.586 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:57:59.582+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:00.328 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:00.324+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:00.628 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:00.624+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:01.373 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:01.368+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:01.669 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:01.665+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:02.422 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:02.419+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:02.629 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:02.625+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:03.406 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:03.402+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:03.601 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:03.597+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:04.441 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:04.437+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:04.562 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:04.558+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:05.421 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:05.417+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:05.591 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:05.587+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:06.380 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:06.377+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:06.576 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:06.571+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:07.384 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:07.380+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:07.592 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:07.588+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:08.426 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:08.422+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:08.631 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:08.628+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:09.421 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:09.418+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:09.643 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:09.640+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:10.402 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:10.399+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:10.649 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:10.646+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:11.361 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:11.358+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:11.657 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:11.654+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:12.360 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:12.357+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:12.689 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:12.686+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:13.360 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:13.358+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:13.643 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:13.640+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:14.380 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:14.377+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:14.616 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:14.613+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:15.427 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:15.424+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:15.579 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:15.576+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:16.413 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:16.410+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:16.572 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:16.569+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:17.381 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:17.378+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:17.555 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:17.552+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:18.419 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:18.416+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:18.582 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:18.579+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:19.459 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:19.456+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:19.595 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:19.592+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:20.431 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:20.428+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:20.582 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:20.580+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:21.400 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:21.397+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:21.544 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:21.542+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:22.398 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:22.395+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:22.497 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:22.494+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:23.371 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:23.368+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:23.502 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:23.500+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:24.419 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:24.416+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:24.532 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:24.529+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:25.386 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:25.383+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:25.575 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:25.572+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:26.342 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:26.339+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:26.565 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:26.562+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:27.382 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:27.379+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:27.615 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:27.612+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:28.340 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:28.338+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:28.587 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:28.584+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:29.383 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:29.380+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:29.583 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:29.580+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:30.342 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:30.336+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:30.600 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:30.597+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:31.295 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:31.292+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:31.566 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:31.563+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:32.327 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:32.324+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:32.557 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:32.554+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:33.335 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:33.332+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:33.555 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:33.552+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:34.344 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:34.341+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:34.543 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:34.540+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:35.331 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:35.328+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:35.538 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:35.535+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:36.376 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:36.373+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:36.493 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:36.490+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:37.355 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:37.352+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:37.479 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:37.476+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:38.313 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:38.310+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:38.468 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:38.465+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:39.265 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:39.262+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:39.421 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:39.418+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:40.235 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:40.232+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:40.391 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:40.388+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:41.211 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:41.208+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:41.396 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:41.393+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:42.189 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:42.185+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:42.421 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:42.417+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:43.211 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:43.207+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:43.457 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:43.453+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:44.235 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:44.231+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:44.471 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:44.467+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:45.275 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:45.271+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:45.440 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:45.436+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:46.270 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:46.267+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:46.471 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:46.467+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:47.321 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:47.317+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:47.444 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:47.440+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:48.306 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:48.301+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:48.480 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:48.476+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:49.268 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:49.265+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:49.450 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:49.446+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:50.227 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:50.223+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:50.448 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:50.445+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:51.272 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:51.269+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:51.430 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:51.427+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:52.226 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:52.223+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:52.452 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:52.449+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:53.260 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:53.258+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:53.412 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:53.409+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:54.278 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:54.275+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:54.379 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:54.377+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:55.254 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:55.251+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:55.365 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:55.363+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:56.270 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:56.267+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:56.416 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:56.413+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:57.257 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:57.254+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:57.441 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:57.439+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:58.234 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:58.231+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:58.424 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:58.421+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:58:59.221 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:58:59.218+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:58:59.467 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:58:59.464+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:00.179 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:00.177+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:00.475 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:00.472+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:01.142 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:01.139+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:01.503 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:01.500+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:02.152 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:02.149+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:02.483 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:02.480+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:03.174 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:03.171+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:03.526 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:03.524+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:04.198 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:04.195+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:04.533 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:04.530+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:05.169 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:05.166+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:05.548 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:05.545+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:06.144 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:06.141+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:06.532 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:06.529+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:07.172 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:07.169+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:07.575 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:07.572+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:08.220 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:08.217+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:08.612 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:08.609+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:09.225 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:09.222+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:09.611 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:09.608+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:10.263 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:10.260+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:10.612 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:10.609+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:11.296 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:11.293+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:11.617 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:11.615+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:12.269 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:12.266+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:12.657 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:12.654+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:13.279 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:13.276+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:13.682 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:13.679+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:14.329 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:14.327+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:14.643 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:14.640+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:15.365 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:15.362+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:15.620 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:15.617+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:16.320 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:16.317+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:16.572 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:16.569+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:17.352 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:17.349+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:17.617 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:17.614+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:18.312 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:18.309+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:18.575 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:18.572+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:19.283 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:19.280+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:19.547 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:19.544+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:20.307 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:20.304+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:20.568 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:20.565+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:21.327 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:21.324+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:21.531 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:21.528+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:22.314 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:22.311+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:22.565 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:22.563+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:23.320 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:23.317+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:23.589 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:23.586+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:24.300 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:24.297+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:24.547 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:24.544+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:25.269 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:25.265+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:25.515 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:25.511+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:26.274 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:26.270+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:26.563 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:26.560+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:27.296 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:27.292+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:27.545 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:27.541+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:28.281 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:28.277+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:28.573 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:28.569+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:29.330 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:29.326+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:29.547 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:29.543+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:30.284 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:30.280+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:30.537 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:30.533+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:31.316 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:31.312+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:31.496 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:31.492+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:32.306 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:32.302+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:32.536 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:32.532+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:33.303 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:33.299+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:33.565 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:33.561+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:34.280 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:34.277+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:34.531 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:34.528+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:35.309 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:35.306+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:35.553 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:35.550+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:36.296 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:36.293+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:36.565 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:36.562+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:37.319 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:37.316+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:37.583 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:37.580+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:38.315 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:38.312+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:38.544 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:38.541+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:39.354 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:39.351+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:39.550 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:39.547+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:40.371 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:40.368+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:40.517 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:40.514+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:41.325 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:41.322+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:41.526 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:41.523+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:42.369 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:42.366+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:42.512 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:42.510+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:43.373 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:43.370+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:43.542 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:43.539+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:44.373 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:44.370+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:44.503 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:44.501+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:45.417 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:45.414+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:45.520 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:45.517+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:46.441 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:46.438+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:46.521 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:46.518+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:47.482 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:47.479+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:47.494 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:47.492+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:48.448 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:48.445+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:48.522 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:48.518+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:49.450 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:49.447+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:49.540 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:49.537+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:50.405 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:50.402+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:50.522 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:50.519+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:51.372 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:51.369+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:51.504 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:51.501+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:52.387 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:52.384+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:52.516 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:52.513+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:53.399 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:53.396+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:53.566 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:53.564+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:54.405 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:54.402+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:54.524 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:54.521+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:55.365 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:55.362+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:55.544 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:55.541+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:56.404 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:56.401+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:56.564 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:56.561+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:57.428 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:57.425+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:57.557 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:57.554+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:58.465 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:58.462+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:58.587 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:58.584+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T16:59:59.496 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T16:59:59.494+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T16:59:59.575 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T16:59:59.572+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:00.516 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:00.513+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:00.592 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:00.589+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:01.544 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:01.541+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:01.548 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:01.545+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:02.553 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:02.550+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:02.569 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:02.566+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:03.544 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:03.541+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:03.586 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:03.583+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:04.523 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:04.520+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:04.557 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:04.554+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:05.552 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:05.549+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:05.578 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:05.575+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:06.518 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:06.515+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:06.557 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:06.554+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:07.501 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:07.498+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:07.519 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:07.516+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:08.474 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:08.470+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:08.495 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:08.491+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:09.463 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:09.459+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:09.487 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:09.483+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:10.475 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:10.471+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:10.493 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:10.489+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:11.472 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:11.468+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:11.508 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:11.504+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:12.427 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:12.423+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:12.493 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:12.489+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:13.390 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:13.386+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:13.455 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:13.451+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:14.398 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:14.394+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:14.500 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:14.496+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:15.409 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:15.405+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:15.509 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:15.505+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:16.391 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:16.387+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:16.535 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:16.531+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:17.384 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:17.381+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:17.491 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:17.488+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:18.408 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:18.405+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:18.492 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:18.489+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:19.412 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:19.409+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:19.515 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:19.512+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:20.366 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:20.363+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:20.477 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:20.474+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:21.345 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:21.342+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:21.445 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:21.442+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:22.334 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:22.331+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:22.470 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:22.467+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:23.312 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:23.309+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:23.439 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:23.436+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:24.345 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:24.342+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:24.430 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:24.427+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:25.309 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:25.306+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:25.437 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:25.433+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:26.340 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:26.337+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:26.464 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:26.461+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:27.360 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:27.357+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:27.491 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:27.488+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:28.345 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:28.342+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:28.482 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:28.479+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:29.327 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:29.323+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:29.446 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:29.443+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:30.328 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:30.325+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:30.409 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:30.406+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:31.287 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:31.284+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:31.364 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:31.361+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:32.312 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:32.309+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:32.415 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:32.412+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:33.280 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:33.277+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:33.448 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:33.445+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:34.330 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:34.327+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:34.423 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:34.420+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:35.340 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:35.337+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:35.450 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:35.447+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:36.386 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:36.383+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:36.483 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:36.480+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:37.395 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:37.392+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:37.500 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:37.497+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:38.349 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:38.345+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:38.485 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:38.482+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:39.365 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:39.361+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:39.456 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:39.453+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:40.389 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:40.385+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:40.496 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:40.493+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:41.407 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:41.404+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:41.492 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:41.489+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:42.381 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:42.378+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:42.529 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:42.524+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:43.406 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:43.403+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:43.530 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:43.527+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:44.377 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:44.373+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:44.528 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:44.525+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:45.365 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:45.362+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:45.549 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:45.546+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:46.380 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:46.377+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:46.556 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:46.553+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:47.362 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:47.359+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:47.550 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:47.547+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:48.400 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:48.397+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:48.552 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:48.549+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:49.410 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:49.407+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:49.503 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:49.501+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:50.365 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:50.361+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:50.535 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:50.531+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:51.324 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:51.320+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:51.542 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:51.538+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:52.360 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:52.356+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:52.528 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:52.524+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:53.348 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:53.344+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:53.575 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:53.571+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:54.304 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:54.300+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:54.532 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:54.527+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:55.298 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:55.294+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:55.530 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:55.525+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:56.313 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:56.309+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:56.490 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:56.486+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:57.348 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:57.344+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:57.505 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:57.501+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:58.339 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:58.335+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:58.479 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:58.475+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:00:59.312 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:00:59.308+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:00:59.454 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:00:59.450+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:00.321 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:00.318+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:00.430 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:00.427+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:01.334 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:01.331+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:01.416 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:01.413+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:02.328 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:02.325+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:02.411 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:02.408+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:03.311 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:03.308+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:03.365 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:03.362+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:04.322 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:04.319+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:04.357 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:04.354+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:05.306 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:05.303+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:05.322 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:05.319+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:06.285 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:06.282+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:06.361 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:06.358+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:07.287 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:07.284+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:07.404 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:07.401+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:08.328 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:08.325+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:08.432 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:08.429+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:09.308 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:09.305+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:09.391 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:09.388+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:10.261 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:10.258+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:10.376 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:10.373+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:11.297 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:11.294+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:11.366 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:11.363+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:12.336 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:12.332+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:12.366 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:12.363+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:13.357 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:13.354+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:13.413 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:13.410+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:14.366 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:14.363+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:14.385 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:14.382+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:15.325 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:15.322+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:15.390 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:15.387+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:16.286 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:16.283+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:16.357 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:16.354+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:17.252 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:17.249+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:17.375 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:17.372+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:18.291 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:18.288+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:18.372 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:18.369+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:19.263 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:19.260+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:19.394 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:19.391+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:20.305 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:20.302+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:20.409 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:20.406+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:21.263 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:21.260+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:21.393 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:21.390+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:22.304 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:22.300+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:22.391 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:22.388+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:23.286 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:23.283+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:23.373 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:23.370+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:24.284 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:24.281+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:24.390 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:24.387+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:25.277 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:25.274+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:25.439 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:25.436+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:26.238 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:26.235+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:26.487 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:26.484+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:27.255 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:27.252+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:27.529 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:27.526+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:28.272 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:28.269+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:28.549 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:28.546+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:29.235 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:29.232+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:29.540 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:29.537+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:30.193 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:30.190+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:30.582 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:30.579+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:31.166 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:31.163+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:31.551 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:31.548+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:32.189 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:32.186+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:32.542 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:32.539+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:33.203 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:33.199+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:33.522 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:33.518+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:34.160 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:34.156+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:34.545 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:34.541+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:35.194 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:35.190+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:35.496 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:35.492+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:36.184 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:36.180+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:36.460 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:36.456+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:37.213 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:37.209+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:37.424 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:37.420+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:38.185 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:38.180+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:38.394 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:38.390+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:39.226 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:39.222+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:39.426 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:39.422+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:40.184 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:40.180+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:40.473 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:40.469+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:41.161 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:41.157+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:41.496 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:41.492+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:42.151 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:42.146+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:42.483 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:42.480+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:43.126 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:43.123+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:43.518 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:43.515+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:44.162 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:44.158+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:44.570 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:44.565+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:45.112 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:45.109+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:45.537 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:45.534+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:46.104 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:46.101+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:46.554 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:46.551+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:47.109 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:47.106+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:47.512 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:47.509+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:48.149 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:48.146+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:48.515 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:48.512+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:49.134 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:49.131+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:49.481 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:49.478+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:50.126 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:50.123+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:50.498 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:50.495+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:51.142 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:51.138+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:51.482 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:51.479+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:52.155 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:52.152+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:52.499 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:52.496+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:53.176 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:53.173+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:53.494 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:53.491+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:54.219 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:54.216+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:54.453 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:54.450+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:55.259 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:55.256+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:55.478 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:55.476+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:56.267 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:56.264+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:56.432 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:56.429+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:57.224 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:57.221+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:57.461 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:57.458+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:58.176 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:58.173+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:58.444 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:58.441+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:01:59.164 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:01:59.161+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:01:59.402 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:01:59.399+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:00.185 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:00.182+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:00.435 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:00.432+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:01.166 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:01.163+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:01.484 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:01.481+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:02.166 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:02.163+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:02.521 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:02.518+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:03.144 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:03.141+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:03.540 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:03.537+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:04.116 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:04.113+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:04.514 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:04.511+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:05.093 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:05.090+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:05.507 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:05.503+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:06.132 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:06.129+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:06.523 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:06.519+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:07.178 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:07.175+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:07.488 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:07.485+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:08.218 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:08.215+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:08.462 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:08.459+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:09.244 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:09.241+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:09.489 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:09.486+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:10.222 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:10.219+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:10.517 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:10.514+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:11.177 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:11.174+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:11.495 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:11.492+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:12.222 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:12.219+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:12.514 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:12.511+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:13.261 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:13.258+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:13.500 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:13.497+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:14.255 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:14.253+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:14.547 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:14.544+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:15.277 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:15.274+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:15.522 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:15.519+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:16.258 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:16.254+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:16.554 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:16.550+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:17.218 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:17.213+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:17.522 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:17.518+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:18.189 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:18.185+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:18.568 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:18.564+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:19.206 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:19.202+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:19.536 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:19.532+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:20.216 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:20.212+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:20.552 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:20.548+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:21.261 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:21.257+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:21.544 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:21.539+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:22.246 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:22.242+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:22.522 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:22.518+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:23.224 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:23.220+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:23.550 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:23.544+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:24.265 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:24.261+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:24.534 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:24.529+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:25.280 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:25.277+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:25.570 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:25.567+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:26.293 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:26.290+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:26.576 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:26.573+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:27.255 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:27.252+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:27.615 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:27.612+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:28.247 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:28.244+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:28.652 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:28.649+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:29.199 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:29.196+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:29.693 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:29.690+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:30.215 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:30.212+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:30.738 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:30.735+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:31.240 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:31.236+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:31.783 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:31.780+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:32.212 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:32.209+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:32.827 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:32.824+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:33.236 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:33.233+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:33.841 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:33.838+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:34.224 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:34.221+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:34.840 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:34.837+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:35.248 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:35.245+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:35.803 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:35.800+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:36.225 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:36.222+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:36.834 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:36.831+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:37.251 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:37.248+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:37.865 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:37.862+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:38.250 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:38.246+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:38.861 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:38.858+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:39.206 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:39.202+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:39.871 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:39.868+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:40.255 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:40.252+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:40.904 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:40.901+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:41.261 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:41.258+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:41.934 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:41.931+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:42.310 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:42.307+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:42.970 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:42.967+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:43.321 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:43.318+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:44.018 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:44.015+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:44.342 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:44.339+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:45.016 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:45.012+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:45.317 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:45.314+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:46.004 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:46.000+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:46.308 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:46.305+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:47.037 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:47.034+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:47.280 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:47.277+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:48.008 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:48.005+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:48.318 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:48.315+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:49.046 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:49.043+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:49.285 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:49.282+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:50.054 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:50.051+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:50.333 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:50.330+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:51.096 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:51.092+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:51.363 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:51.360+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:52.064 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:52.060+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:52.319 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:52.316+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:53.031 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:53.028+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:53.287 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:53.283+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:54.006 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:54.003+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:54.277 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:54.274+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:55.025 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:55.022+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:55.320 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:55.317+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:56.012 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:56.009+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:56.291 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:56.288+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:57.001 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:56.998+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:57.322 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:57.319+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:57.962 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:57.959+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:58.279 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:58.276+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:58.942 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:58.938+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:02:59.275 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:02:59.271+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:02:59.972 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:02:59.968+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:00.244 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:00.240+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:00.972 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:00.964+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:01.224 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:01.220+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:02.000 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:01.994+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:02.261 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:02.257+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:03.034 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:03.030+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:03.302 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:03.298+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:04.044 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:04.040+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:04.263 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:04.258+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:05.093 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:05.089+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:05.266 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:05.262+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:06.126 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:06.123+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:06.288 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:06.284+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:07.159 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:07.155+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:07.295 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:07.291+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:08.129 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:08.126+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:08.260 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:08.257+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:09.103 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:09.100+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:09.275 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:09.272+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:10.130 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:10.127+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:10.317 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:10.314+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:11.123 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:11.120+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:11.297 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:11.294+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:12.128 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:12.125+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:12.327 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:12.324+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:13.114 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:13.111+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:13.308 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:13.305+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:14.101 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:14.098+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:14.351 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:14.348+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:15.092 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:15.089+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:15.333 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:15.330+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:16.043 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:16.040+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:16.295 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:16.291+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:17.015 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:17.012+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:17.261 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:17.258+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:17.997 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:17.994+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:18.217 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:18.214+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:19.023 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:19.020+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:19.244 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:19.241+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:20.051 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:20.048+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:20.287 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:20.284+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:21.021 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:21.018+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:21.331 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:21.328+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:22.013 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:22.010+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:22.353 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:22.350+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:22.991 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:22.988+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:23.366 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:23.363+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:23.956 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:23.953+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:24.325 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:24.322+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:24.975 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:24.972+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:25.341 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:25.338+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:25.963 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:25.960+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:26.343 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:26.340+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:26.957 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:26.954+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:27.361 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:27.358+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:27.917 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:27.914+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:28.345 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:28.341+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:28.881 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:28.878+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:29.383 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:29.380+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:29.857 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:29.854+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:30.357 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:30.354+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:30.862 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:30.859+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:31.371 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:31.368+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:31.889 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:31.886+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:32.384 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:32.381+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:32.889 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:32.886+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:33.351 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:33.348+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:33.849 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:33.846+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:34.321 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:34.318+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:34.883 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:34.880+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:35.349 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:35.346+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:35.843 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:35.839+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:36.393 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:36.389+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:36.840 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:36.837+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:37.418 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:37.415+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:37.828 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:37.825+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:38.463 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:38.460+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:38.841 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:38.838+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:39.455 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:39.452+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:39.889 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:39.886+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:40.489 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:40.485+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:40.879 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:40.876+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:41.485 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:41.480+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:41.901 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:41.897+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:42.469 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:42.464+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:42.943 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:42.939+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:43.498 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:43.494+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:43.972 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:43.968+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:44.481 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:44.477+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:44.987 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:44.982+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:45.502 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:45.498+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:46.029 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:46.025+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:46.471 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:46.467+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:47.006 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:47.002+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:47.478 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:47.474+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:48.041 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:48.037+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:48.441 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:48.437+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:49.085 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:49.081+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:49.397 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:49.393+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:50.043 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:50.039+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:50.389 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:50.386+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:51.032 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:51.029+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:51.417 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:51.414+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:52.043 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:52.040+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:52.441 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:52.438+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:53.031 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:53.028+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:53.478 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:53.475+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:54.044 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:54.041+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:54.480 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:54.477+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:55.083 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:55.080+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:55.520 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:55.516+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:56.058 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:56.055+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:56.476 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:56.473+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:57.069 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:57.066+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:57.500 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:57.497+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:58.060 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:58.057+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:58.544 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:58.541+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:03:59.087 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:03:59.084+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:03:59.530 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:03:59.527+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:00.122 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:00.119+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:00.548 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:00.545+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:01.076 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:01.073+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:01.540 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:01.537+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:02.066 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:02.063+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:02.498 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:02.495+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:03.035 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:03.032+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:03.536 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:03.533+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:03.990 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:03.987+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:04.551 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:04.548+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:04.980 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:04.977+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:05.550 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:05.547+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:06.018 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:06.015+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:06.537 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:06.534+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:07.044 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:07.041+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:07.562 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:07.559+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:08.068 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:08.065+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:08.526 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:08.523+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:09.045 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:09.042+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:09.571 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:09.568+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:10.082 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:10.079+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:10.564 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:10.561+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:11.104 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:11.101+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:11.589 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:11.586+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:12.144 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:12.141+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:12.546 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:12.543+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:13.106 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:13.103+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:13.522 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:13.518+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:14.118 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:14.115+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:14.542 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:14.539+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:15.122 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:15.119+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:15.552 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:15.549+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:16.088 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:16.085+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:16.552 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:16.549+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:17.111 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:17.108+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:17.549 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:17.546+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:18.096 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:18.093+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:18.581 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:18.576+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:19.093 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:19.090+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:19.565 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:19.562+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:20.088 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:20.085+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:20.616 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:20.613+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:21.076 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:21.073+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:21.636 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:21.633+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:22.050 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:22.047+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:22.652 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:22.648+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:23.060 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:23.057+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:23.682 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:23.678+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:24.072 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:24.067+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:24.654 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:24.650+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:25.027 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:25.022+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:25.631 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:25.627+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:26.016 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:26.012+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:26.616 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:26.612+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:26.969 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:26.965+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:27.586 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:27.581+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:27.945 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:27.941+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:28.567 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:28.563+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:28.988 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:28.984+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:29.598 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:29.593+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:29.996 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:29.992+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:30.602 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:30.599+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:30.989 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:30.986+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:31.628 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:31.624+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:32.021 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:32.016+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:32.592 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:32.588+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:33.067 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:33.064+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:33.610 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:33.607+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:34.086 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:34.083+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:34.605 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:34.602+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:35.095 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:35.092+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:35.557 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:35.554+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:36.070 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:36.067+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:36.583 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:36.580+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:37.068 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:37.065+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:37.618 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:37.615+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:38.113 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:38.110+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:38.594 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:38.591+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:39.091 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:39.088+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:39.638 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:39.635+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:40.081 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:40.078+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:40.661 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:40.657+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:41.117 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:41.114+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:41.652 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:41.649+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:42.090 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:42.087+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:42.674 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:42.671+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:43.106 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:43.103+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:43.718 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:43.715+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:44.149 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:44.146+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:44.676 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:44.673+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:45.156 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:45.153+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:45.698 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:45.695+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:46.120 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:46.117+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:46.663 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:46.660+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:47.084 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:47.081+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:47.656 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:47.653+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:48.132 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:48.129+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:48.709 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:48.703+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:49.125 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:49.121+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:49.688 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:49.685+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:50.166 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:50.162+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:50.678 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:50.675+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:51.212 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:51.209+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:51.696 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:51.693+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:52.251 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:52.248+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:52.651 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:52.648+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:53.256 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:53.253+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:53.693 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:53.690+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:54.256 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:54.253+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:54.709 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:54.706+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:55.242 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:55.239+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:55.702 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:55.699+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:56.223 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:56.220+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:56.701 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:56.697+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:57.188 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:57.185+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:57.662 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:57.659+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:58.145 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:58.142+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:58.629 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:58.626+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:04:59.150 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:04:59.147+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:04:59.582 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:04:59.579+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:00.185 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:00.182+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:00.556 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:00.553+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:01.143 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:01.140+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:01.572 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:01.568+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:02.182 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:02.179+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:02.564 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:02.561+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:03.160 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:03.157+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:03.582 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:03.578+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:04.134 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:04.131+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:04.621 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:04.618+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:05.178 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:05.175+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:05.596 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:05.593+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:06.136 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:06.132+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:06.572 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:06.568+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:07.115 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:07.111+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:07.574 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:07.570+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:08.157 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:08.153+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:08.574 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:08.569+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:09.200 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:09.196+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:09.592 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:09.588+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:10.205 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:10.201+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:10.586 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:10.582+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:11.158 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:11.154+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:11.636 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:11.632+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:12.156 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:12.152+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:12.600 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:12.596+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:13.194 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:13.190+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:13.607 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:13.603+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:14.183 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:14.180+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:14.589 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:14.585+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:15.155 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:15.152+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:15.608 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:15.604+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:16.176 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:16.173+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:16.633 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:16.630+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:17.174 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:17.171+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:17.600 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:17.597+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:18.220 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:18.217+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:18.626 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:18.623+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:19.179 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:19.176+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:19.675 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:19.672+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:20.207 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:20.204+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:20.675 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:20.672+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:21.170 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:21.166+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:21.694 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:21.691+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:22.208 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:22.205+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:22.729 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:22.726+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:23.191 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:23.188+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:23.723 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:23.720+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:24.164 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:24.161+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:24.734 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:24.731+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:25.152 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:25.149+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:25.753 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:25.750+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:26.182 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:26.179+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:26.720 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:26.716+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:27.189 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:27.186+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:27.693 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:27.690+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:28.228 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:28.224+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:28.651 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:28.648+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:29.271 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:29.267+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:29.682 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:29.679+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:30.267 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:30.264+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:30.638 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:30.635+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:31.226 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:31.223+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:31.646 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:31.643+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:32.210 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:32.207+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:32.644 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:32.641+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:33.162 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:33.159+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:33.597 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:33.594+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:34.145 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:34.141+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:34.632 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:34.629+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:35.106 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:35.103+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:35.658 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:35.655+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:36.118 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:36.115+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:36.666 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:36.663+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:37.161 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:37.157+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:37.670 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:37.667+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:38.174 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:38.171+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:38.652 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:38.649+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:39.181 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:39.177+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:39.686 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:39.682+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:40.230 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:40.226+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:40.702 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:40.699+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:41.275 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:41.272+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:41.691 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:41.688+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:42.238 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:42.234+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:42.734 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:42.731+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:43.260 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:43.257+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:43.724 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:43.721+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:44.270 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:44.267+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:44.716 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:44.713+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:45.265 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:45.262+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:45.703 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:45.700+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:46.316 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:46.313+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:46.712 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:46.709+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:47.316 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:47.313+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:47.744 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:47.741+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:48.332 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:48.328+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:48.760 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:48.756+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:49.332 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:49.327+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:49.804 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:49.800+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:50.378 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:50.373+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:50.822 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:50.817+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:51.370 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:51.366+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:51.828 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:51.824+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:52.370 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:52.366+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:52.792 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:52.788+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:53.335 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:53.330+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:53.754 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:53.750+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:54.346 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:54.342+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:54.784 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:54.780+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:55.309 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:55.305+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:55.788 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:55.783+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:56.302 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:56.298+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:56.778 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:56.774+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:57.308 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:57.305+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:57.746 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:57.743+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:58.290 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:58.287+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:58.740 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:58.737+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:05:59.296 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:05:59.293+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:05:59.702 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:05:59.699+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:00.281 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:00.278+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:00.685 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:00.682+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:01.251 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:01.248+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:01.656 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:01.653+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:02.219 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:02.216+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:02.639 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:02.636+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:03.201 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:03.198+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:03.602 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:03.599+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:04.210 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:04.207+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:04.570 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:04.566+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:05.167 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:05.164+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:05.538 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:05.535+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:06.168 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:06.165+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:06.514 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:06.511+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:07.217 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:07.214+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:07.502 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:07.499+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:08.174 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:08.171+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:08.474 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:08.471+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:09.196 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:09.193+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:09.440 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:09.437+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:10.202 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:10.199+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:10.426 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:10.423+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:11.223 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:11.220+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:11.422 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:11.418+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:12.200 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:12.196+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:12.444 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:12.441+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:13.238 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:13.234+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:13.436 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:13.433+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:14.270 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:14.266+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:14.400 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:14.397+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:15.226 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:15.223+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:15.382 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:15.379+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:16.208 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:16.204+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:16.404 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:16.401+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:17.180 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:17.176+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:17.434 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:17.431+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:18.182 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:18.179+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:18.458 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:18.455+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:19.165 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:19.159+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:19.500 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:19.497+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:20.182 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:20.179+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:20.470 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:20.467+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:21.148 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:21.145+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:21.454 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:21.451+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:22.125 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:22.122+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:22.500 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:22.497+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:23.097 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:23.094+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:23.454 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:23.451+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:24.115 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:24.112+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:24.418 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:24.415+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:25.109 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:25.106+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:25.412 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:25.409+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:26.067 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:26.064+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:26.391 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:26.388+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:27.075 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:27.072+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:27.439 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:27.436+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:28.096 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:28.092+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:28.423 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:28.420+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:29.095 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:29.092+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:29.380 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:29.377+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:30.104 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:30.100+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:30.332 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:30.329+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:31.122 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:31.117+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:31.306 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:31.302+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:32.150 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:32.145+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:32.313 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:32.308+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:33.134 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:33.130+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:33.348 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:33.343+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:34.137 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:34.133+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:34.313 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:34.309+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:35.112 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:35.108+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:35.360 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:35.356+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:36.144 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:36.140+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:36.312 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:36.308+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:37.134 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:37.130+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:37.332 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:37.327+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:38.094 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:38.090+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:38.362 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:38.358+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:39.124 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:39.120+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:39.386 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:39.382+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:40.171 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:40.168+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:40.421 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:40.418+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:41.163 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:41.159+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:41.407 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:41.404+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:42.124 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:42.121+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:42.381 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:42.378+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:43.167 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:43.164+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:43.338 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:43.335+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:44.195 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:44.192+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:44.336 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:44.333+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:45.202 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:45.199+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:45.313 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:45.310+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:46.165 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:46.162+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:46.305 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:46.302+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:47.195 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:47.192+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:47.344 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:47.341+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:48.235 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:48.232+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:48.296 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:48.293+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:49.231 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:49.228+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:49.327 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:49.324+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:50.215 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:50.212+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:50.349 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:50.346+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:51.244 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:51.241+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:51.370 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:51.367+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:52.219 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:52.215+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:52.415 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:52.412+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:53.259 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:53.256+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:53.419 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:53.416+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:54.277 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:54.273+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:54.407 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:54.404+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:55.232 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:55.228+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:55.371 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:55.368+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:56.223 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:56.220+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:56.422 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:56.418+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:57.209 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:57.206+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:57.385 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:57.382+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:58.195 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:58.192+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:58.411 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:58.407+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:06:59.211 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:06:59.207+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:06:59.424 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:06:59.420+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:00.197 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:00.194+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:00.411 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:00.408+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:01.175 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:01.172+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:01.429 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:01.425+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:02.217 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:02.214+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:02.391 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:02.388+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:03.242 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:03.239+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:03.409 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:03.406+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:04.279 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:04.276+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:04.407 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:04.403+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:05.276 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:05.273+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:05.403 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:05.400+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:06.319 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:06.315+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:06.431 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:06.428+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:07.325 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:07.322+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:07.392 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:07.389+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:08.315 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:08.312+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:08.345 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:08.342+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:09.298 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:09.295+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:09.321 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:09.317+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:10.336 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:10.333+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:10.365 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:10.362+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:11.303 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:11.300+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:11.404 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:11.401+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:12.327 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:12.324+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:12.364 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:12.361+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:13.368 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:13.363+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:13.374 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:13.370+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:14.345 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:14.341+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:14.421 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:14.416+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:15.344 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:15.340+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:15.467 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:15.462+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:16.319 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:16.314+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:16.428 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:16.424+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:17.323 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:17.318+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:17.396 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:17.392+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:18.312 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:18.308+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:18.401 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:18.397+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:19.341 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:19.337+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:19.376 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:19.371+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:20.349 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:20.345+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:20.386 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:20.382+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:21.326 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:21.321+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:21.370 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:21.366+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:22.309 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:22.306+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:22.365 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:22.362+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:23.279 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:23.276+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:23.332 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:23.329+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:24.317 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:24.314+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:24.364 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:24.361+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:25.336 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:25.332+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:25.342 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:25.338+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:26.322 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:26.319+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:26.336 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:26.333+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:27.354 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:27.351+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:27.358 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:27.355+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:28.337 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:28.333+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:28.404 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:28.400+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:29.311 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:29.308+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:29.355 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:29.352+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:30.290 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:30.287+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:30.312 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:30.309+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:31.267 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:31.264+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:31.280 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:31.276+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:32.254 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:32.250+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:32.282 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:32.279+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:33.285 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:33.282+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:33.293 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:33.290+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:34.257 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:34.254+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:34.330 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:34.327+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:35.302 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:35.299+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:35.353 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:35.349+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:36.320 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:36.317+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:36.340 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:36.337+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:37.276 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:37.273+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:37.368 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:37.365+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:38.300 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:38.297+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:38.321 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:38.317+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:39.294 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:39.291+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:39.299 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:39.296+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:40.276 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:40.273+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:40.308 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:40.305+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:41.255 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:41.251+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:41.270 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:41.267+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:42.217 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:42.214+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:42.298 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:42.295+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:43.220 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:43.217+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:43.275 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:43.272+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:44.269 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:44.266+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:44.290 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:44.287+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:45.228 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:45.225+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:45.244 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:45.241+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:46.212 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:46.209+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:46.272 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:46.269+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:47.257 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:47.253+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:47.290 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:47.287+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:48.242 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:48.238+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:48.252 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:48.249+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:49.220 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:49.217+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:49.265 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:49.262+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:50.184 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:50.180+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:50.302 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:50.299+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:51.178 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:51.175+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:51.312 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:51.308+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:52.181 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:52.178+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:52.327 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:52.324+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:53.162 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:53.159+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:53.299 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:53.296+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:54.188 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:54.185+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:54.336 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:54.333+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:55.221 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:55.217+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:55.339 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:55.336+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:56.188 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:56.183+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:56.341 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:56.337+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:57.167 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:57.163+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:57.370 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:57.366+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:58.172 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:58.168+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:58.402 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:58.397+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:07:59.220 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:07:59.216+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:07:59.376 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:07:59.372+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:00.269 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:00.265+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:00.376 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:00.372+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:01.267 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:01.263+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:01.371 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:01.367+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:02.224 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:02.220+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:02.405 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:02.401+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:03.199 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:03.195+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:03.445 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:03.441+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:04.154 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:04.149+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:04.417 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:04.413+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:05.125 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:05.122+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:05.401 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:05.398+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:06.106 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:06.102+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:06.442 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:06.438+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:07.084 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:07.081+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:07.463 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:07.460+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:08.101 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:08.097+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:08.429 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:08.426+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:09.077 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:09.072+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:09.397 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:09.393+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:10.105 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:10.102+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:10.427 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:10.423+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:11.130 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:11.127+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:11.414 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:11.410+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:12.119 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:12.116+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:12.373 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:12.370+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:13.119 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:13.116+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:13.383 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:13.380+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:14.075 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:14.072+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:14.339 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:14.336+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:15.086 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:15.083+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:15.331 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:15.328+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:16.039 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:16.036+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:16.328 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:16.325+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:17.090 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:17.086+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:17.369 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:17.366+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:18.073 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:18.070+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:18.322 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:18.318+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:19.055 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:19.052+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:19.284 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:19.281+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:20.018 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:20.014+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:20.310 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:20.306+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:20.979 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:20.975+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:21.315 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:21.312+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:21.945 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:21.942+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:22.287 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:22.284+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:22.931 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:22.928+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:23.252 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:23.248+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:23.908 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:23.905+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:24.206 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:24.202+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:24.886 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:24.882+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:25.178 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:25.175+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:25.857 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:25.853+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:26.163 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:26.160+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:26.863 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:26.860+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:27.149 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:27.146+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:27.842 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:27.839+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:28.181 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:28.177+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:28.864 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:28.860+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:29.164 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:29.161+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:29.815 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:29.812+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:30.212 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:30.209+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:30.782 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:30.779+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:31.172 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:31.169+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:31.773 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:31.769+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:32.175 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:32.172+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:32.807 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:32.803+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:33.148 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:33.144+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:33.777 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:33.774+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:34.147 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:34.144+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:34.741 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:34.738+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:35.181 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:35.178+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:35.695 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:35.692+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:36.144 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:36.141+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:36.718 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:36.715+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:37.152 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:37.149+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:37.731 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:37.728+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:38.169 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:38.165+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:38.759 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:38.754+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:39.166 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:39.161+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:39.767 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:39.762+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:40.153 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:40.149+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:40.760 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:40.755+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:41.125 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:41.121+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:41.758 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:41.754+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:42.175 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:42.171+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:42.759 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:42.755+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:43.175 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:43.170+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:43.750 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:43.745+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:44.130 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:44.126+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:44.781 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:44.777+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:45.179 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:45.174+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:45.830 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:45.826+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:46.151 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:46.147+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:46.796 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:46.792+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:47.182 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:47.178+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:47.791 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:47.788+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:48.232 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:48.229+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:48.758 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:48.755+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:49.236 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:49.232+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:49.733 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:49.730+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:50.187 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:50.184+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:50.731 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:50.728+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:51.163 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:51.160+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:51.743 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:51.740+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:52.117 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:52.114+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:52.724 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:52.720+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:53.073 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:53.069+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:53.761 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:53.757+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:54.105 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:54.101+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:54.800 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:54.796+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:55.138 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:55.135+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:55.757 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:55.754+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:56.123 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:56.119+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:56.781 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:56.778+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:57.117 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:57.114+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:57.802 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:57.798+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:58.133 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:58.130+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:58.831 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:58.828+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:08:59.163 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:08:59.159+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:08:59.874 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:08:59.871+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:00.173 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:00.169+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:00.842 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:00.838+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:01.202 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:01.199+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:01.805 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:01.802+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:02.167 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:02.164+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:02.771 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:02.768+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:03.119 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:03.115+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:03.733 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:03.730+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:04.113 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:04.110+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:04.721 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:04.718+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:05.148 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:05.145+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:05.724 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:05.720+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:06.123 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:06.120+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:06.689 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:06.685+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:07.120 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:07.116+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:07.733 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:07.730+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:08.125 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:08.122+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:08.685 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:08.682+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:09.089 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:09.085+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:09.735 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:09.732+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:10.085 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:10.082+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:10.725 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:10.721+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:11.097 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:11.094+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:11.717 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:11.714+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:12.092 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:12.088+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:12.672 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:12.668+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:13.087 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:13.084+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:13.717 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:13.714+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:14.117 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:14.114+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:14.698 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:14.694+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:15.089 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:15.086+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:15.656 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:15.652+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:16.139 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:16.135+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:16.653 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:16.650+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:17.119 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:17.115+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:17.608 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:17.605+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:18.151 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:18.148+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:18.603 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:18.599+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:19.123 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:19.119+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:19.647 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:19.644+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:20.138 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:20.135+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:20.655 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:20.652+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:21.160 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:21.156+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:21.678 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:21.673+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:22.149 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:22.144+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:22.643 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:22.638+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:23.110 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:23.105+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:23.660 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:23.655+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:24.090 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:24.083+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:24.681 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:24.677+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:25.043 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:25.038+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:25.717 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:25.713+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:26.057 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:26.053+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:26.754 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:26.750+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:27.104 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:27.100+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:27.730 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:27.725+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:28.059 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:28.054+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:28.766 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:28.762+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:29.090 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:29.085+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:29.773 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:29.769+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:30.092 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:30.089+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:30.729 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:30.725+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:31.044 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:31.041+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:31.705 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:31.701+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:32.020 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:32.017+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:32.668 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:32.665+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:33.052 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:33.049+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:33.707 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:33.704+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:34.069 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:34.066+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:34.673 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:34.669+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:35.084 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:35.081+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:35.711 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:35.708+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:36.063 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:36.060+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:36.762 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:36.758+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:37.060 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:37.057+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:37.809 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:37.806+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:38.103 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:38.099+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:38.821 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:38.817+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:39.147 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:39.143+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:39.780 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:39.777+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:40.152 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:40.149+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:40.796 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:40.793+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:41.189 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:41.186+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:41.785 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:41.781+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:42.218 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:42.215+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:42.745 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:42.741+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:43.245 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:43.242+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:43.720 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:43.717+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:44.280 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:44.276+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:44.748 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:44.745+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:45.300 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:45.296+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:45.781 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:45.778+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:46.279 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:46.276+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:46.830 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:46.827+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:47.254 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:47.251+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:47.823 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:47.819+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:48.230 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:48.227+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:48.817 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:48.813+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:49.233 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:49.229+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:49.778 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:49.775+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:50.231 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:50.227+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:50.760 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:50.757+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:51.238 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:51.235+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:51.799 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:51.796+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:52.243 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:52.239+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:52.770 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:52.767+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:53.231 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:53.227+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:53.769 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:53.764+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:54.211 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:54.207+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:54.756 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:54.753+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:55.186 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:55.183+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:55.714 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:55.710+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:56.210 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:56.207+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:56.752 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:56.749+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:57.230 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:57.227+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:57.760 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:57.757+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:58.185 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:58.181+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:58.794 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:58.790+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:09:59.176 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:09:59.173+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:09:59.824 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:09:59.820+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:00.200 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:00.196+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:00.866 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:00.863+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:01.242 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:01.239+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:01.833 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:01.829+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:02.268 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:02.265+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:02.835 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:02.831+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:03.286 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:03.281+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:03.870 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:03.866+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:04.259 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:04.255+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:04.874 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:04.870+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:05.245 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:05.241+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:05.875 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:05.871+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:06.241 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:06.236+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:06.893 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:06.888+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:07.195 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:07.191+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:07.907 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:07.902+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:08.157 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:08.152+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:08.867 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:08.862+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:09.199 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:09.194+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:09.853 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:09.849+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:10.224 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:10.219+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:10.840 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:10.836+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:11.206 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:11.201+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:11.831 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:11.827+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:12.164 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:12.160+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:12.844 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:12.841+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:13.151 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:13.148+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:13.812 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:13.808+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:14.122 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:14.118+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:14.846 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:14.843+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:15.153 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:15.150+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:15.865 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:15.861+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:16.112 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:16.109+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:16.864 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:16.861+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:17.099 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:17.096+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:17.885 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:17.882+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:18.087 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:18.084+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:18.883 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:18.879+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:19.045 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:19.042+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:19.862 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:19.858+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:20.059 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:20.056+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:20.906 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:20.902+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:21.068 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:21.065+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:21.915 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:21.912+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:22.043 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:22.040+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:22.953 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:22.950+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:23.009 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:23.006+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:23.945 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:23.942+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:24.030 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:24.027+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:24.972 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:24.969+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:25.037 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:25.033+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:26.008 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:26.004+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:26.023 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:26.019+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:27.003 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:27.000+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:27.021 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:27.018+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:27.965 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:27.961+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:27.983 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:27.979+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:28.951 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:28.948+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:28.987 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:28.984+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:29.953 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:29.949+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:29.995 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:29.992+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:30.985 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:30.982+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:31.006 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:31.002+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:31.953 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:31.950+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:31.985 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:31.981+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:32.940 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:32.937+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:32.977 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:32.974+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:33.892 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:33.889+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:34.021 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:34.018+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:34.881 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:34.878+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:35.022 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:35.018+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:35.923 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:35.920+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:36.003 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:36.000+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:36.935 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:36.932+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:36.957 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:36.954+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:37.908 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:37.905+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:37.932 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:37.929+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:38.862 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:38.856+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:38.967 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:38.964+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:39.811 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:39.808+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:40.004 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:40.000+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:40.855 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:40.852+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:41.017 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:41.014+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:41.861 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:41.858+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:41.992 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:41.989+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:42.857 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:42.854+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:42.956 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:42.952+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:43.835 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:43.831+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:43.951 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:43.948+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:44.788 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:44.785+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:44.997 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:44.994+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:45.773 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:45.769+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:45.988 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:45.984+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:46.764 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:46.760+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:46.950 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:46.945+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:47.784 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:47.779+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:48.000 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:47.995+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:48.779 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:48.775+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:48.983 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:48.979+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:49.763 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:49.759+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:50.021 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:50.017+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:50.763 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:50.758+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:50.977 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:50.973+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:51.775 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:51.771+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:51.989 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:51.985+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:52.787 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:52.783+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:53.017 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:53.013+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:53.814 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:53.810+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:53.983 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:53.979+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:54.852 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:54.849+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:54.969 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:54.966+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:55.862 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:55.859+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:56.016 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:56.012+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:56.862 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:56.859+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:57.020 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:57.017+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:57.830 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:57.827+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:58.026 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:58.022+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:58.849 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:58.846+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:58.982 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:58.979+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:10:59.831 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:10:59.828+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:10:59.969 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:10:59.966+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:00.862 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:00.859+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:00.984 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:00.981+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:01.822 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:01.819+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:02.023 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:02.020+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:02.864 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:02.861+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:03.021 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:03.018+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:03.900 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:03.897+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:04.050 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:04.047+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:04.927 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:04.924+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:05.040 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:05.037+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:05.930 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:05.927+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:06.057 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:06.054+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:06.974 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:06.970+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:07.100 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:07.097+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:07.932 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:07.928+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:08.098 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:08.095+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:08.923 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:08.920+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:09.092 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:09.089+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:09.893 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:09.890+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:10.104 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:10.101+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:10.892 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:10.888+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:11.074 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:11.071+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:11.917 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:11.914+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:12.081 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:12.078+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:12.906 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:12.903+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:13.038 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:13.035+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:13.934 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:13.931+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:14.084 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:14.081+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:14.973 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:14.970+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:15.132 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:15.128+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:16.004 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:16.001+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:16.149 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:16.145+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:16.970 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:16.966+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:17.118 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:17.115+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:17.962 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:17.959+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:18.157 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:18.137+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:18.982 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:18.979+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:19.098 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:19.095+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:19.968 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:19.965+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:20.146 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:20.143+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:21.000 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:20.997+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:21.178 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:21.175+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:22.023 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:22.020+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:22.148 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:22.145+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:23.016 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:23.013+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:23.175 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:23.172+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:23.970 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:23.967+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:24.144 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:24.141+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:24.936 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:24.933+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:25.136 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:25.132+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:25.976 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:25.973+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:26.168 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:26.165+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:27.025 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:27.021+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:27.124 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:27.121+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:27.993 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:27.989+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:28.107 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:28.103+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:29.019 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:29.015+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:29.099 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:29.095+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:30.052 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:30.048+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:30.142 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:30.138+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:31.064 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:31.059+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:31.118 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:31.114+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:32.084 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:32.080+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:32.161 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:32.156+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:33.122 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:33.118+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:33.127 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:33.123+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:34.158 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:34.154+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:34.162 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:34.158+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:35.169 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:35.165+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:35.192 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:35.188+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:36.197 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:36.193+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:36.218 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:36.214+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:37.164 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:37.161+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:37.236 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:37.233+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:38.122 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:38.119+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:38.210 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:38.207+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:39.108 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:39.105+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:39.172 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:39.169+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:40.094 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:40.091+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:40.222 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:40.219+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:41.095 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:41.092+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:41.218 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:41.215+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:42.100 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:42.097+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:42.220 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:42.217+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:43.141 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:43.138+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:43.236 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:43.233+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:44.177 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:44.174+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:44.222 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:44.219+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:45.188 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:45.185+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:45.251 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:45.248+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:46.224 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:46.220+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:46.230 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:46.227+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:47.185 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:47.182+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:47.230 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:47.227+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:48.164 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:48.161+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:48.232 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:48.229+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:49.187 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:49.184+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:49.213 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:49.210+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:50.184 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:50.180+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:50.217 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:50.214+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:51.177 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:51.174+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:51.214 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:51.211+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:52.224 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:52.221+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:52.226 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:52.223+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:53.216 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:53.213+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:53.264 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:53.261+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:54.216 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:54.213+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:54.286 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:54.283+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:55.195 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:55.191+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:55.258 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:55.255+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:56.176 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:56.172+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:56.290 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:56.287+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:57.169 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:57.165+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:57.285 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:57.282+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:58.196 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:58.193+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:58.310 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:58.307+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:11:59.164 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:11:59.161+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:11:59.293 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:11:59.290+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:00.167 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:00.164+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:00.280 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:00.277+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:01.132 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:01.129+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:01.262 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:01.259+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:02.131 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:02.128+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:02.229 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:02.226+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:03.127 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:03.124+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:03.272 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:03.269+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:04.118 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:04.115+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:04.278 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:04.275+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:05.132 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:05.129+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:05.262 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:05.259+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:06.139 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:06.136+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:06.287 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:06.284+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:07.188 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:07.185+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:07.298 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:07.295+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:08.178 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:08.174+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:08.333 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:08.330+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:09.224 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:09.221+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:09.284 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:09.281+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:10.252 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:10.248+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:10.253 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:10.249+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:11.243 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:11.239+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:11.278 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:11.274+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:12.195 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:12.191+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:12.322 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:12.318+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:13.218 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:13.214+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:13.363 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:13.359+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:14.229 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:14.225+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:14.382 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:14.378+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:15.261 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:15.254+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:15.394 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:15.389+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:16.261 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:16.257+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:16.358 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:16.353+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:17.238 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:17.234+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:17.381 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:17.377+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:18.197 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:18.193+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:18.418 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:18.414+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:19.175 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:19.171+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:19.383 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:19.380+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:20.173 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:20.170+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:20.355 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:20.352+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:21.177 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:21.174+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:21.338 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:21.334+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:22.145 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:22.142+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:22.290 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:22.287+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:23.125 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:23.122+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:23.282 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:23.279+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:24.161 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:24.158+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:24.260 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:24.257+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:25.190 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:25.186+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:25.230 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:25.227+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:26.175 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:26.172+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:26.205 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:26.202+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:27.197 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:27.194+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:27.231 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:27.228+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:28.158 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:28.155+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:28.251 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:28.248+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:29.191 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:29.188+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:29.276 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:29.273+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:30.206 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:30.203+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:30.274 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:30.271+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:31.212 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:31.209+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:31.309 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:31.306+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:32.229 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:32.226+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:32.296 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:32.292+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:33.182 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:33.179+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:33.278 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:33.275+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:34.219 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:34.216+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:34.268 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:34.265+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:35.217 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:35.214+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:35.299 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:35.296+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:36.225 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:36.222+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:36.255 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:36.252+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:37.265 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:37.262+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:37.269 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:37.266+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:38.264 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:38.261+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:38.277 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:38.273+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:39.222 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:39.219+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:39.298 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:39.295+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:40.238 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:40.235+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:40.293 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:40.290+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:41.230 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:41.227+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:41.283 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:41.280+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:42.251 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:42.248+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:42.292 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:42.289+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:43.218 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:43.215+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:43.304 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:43.301+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:44.180 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:44.177+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:44.312 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:44.308+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:45.214 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:45.211+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:45.271 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:45.268+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:46.230 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:46.227+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:46.251 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:46.248+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:47.190 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:47.187+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:47.243 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:47.240+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:48.190 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:48.187+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:48.244 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:48.241+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:49.170 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:49.167+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:49.266 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:49.263+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:50.171 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:50.168+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:50.313 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:50.310+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:51.181 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:51.178+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:51.294 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:51.291+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:52.166 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:52.163+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:52.332 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:52.328+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:53.181 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:53.176+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:53.349 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:53.345+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:54.213 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:54.208+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:54.371 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:54.367+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:55.222 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:55.218+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:55.353 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:55.349+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:56.199 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:56.195+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:56.334 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:56.329+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:57.222 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:57.218+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:57.338 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:57.334+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:58.237 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:58.233+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:58.353 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:58.347+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:12:59.286 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:12:59.281+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:12:59.327 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:12:59.324+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:00.266 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:00.262+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:00.373 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:00.370+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:01.284 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:01.281+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:01.340 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:01.337+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:02.295 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:02.292+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:02.356 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:02.353+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:03.259 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:03.256+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:03.318 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:03.315+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:04.283 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:04.280+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:04.289 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:04.285+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:05.297 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:05.294+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:05.303 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:05.300+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:06.295 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:06.292+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:06.321 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:06.318+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:07.258 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:07.255+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:07.316 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:07.313+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:08.217 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:08.214+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:08.323 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:08.320+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:09.225 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:09.222+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:09.355 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:09.352+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:10.275 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:10.272+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:10.384 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:10.381+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:11.303 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:11.300+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:11.390 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:11.387+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:12.274 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:12.271+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:12.419 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:12.416+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:13.230 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:13.227+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:13.419 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:13.416+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:14.194 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:14.191+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:14.432 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:14.429+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:15.169 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:15.166+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:15.421 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:15.418+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:16.168 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:16.165+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:16.417 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:16.414+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:17.132 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:17.129+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:17.464 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:17.461+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:18.106 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:18.103+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:18.499 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:18.496+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:19.124 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:19.121+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:19.467 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:19.464+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:20.095 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:20.092+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:20.435 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:20.432+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:21.102 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:21.099+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:21.400 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:21.397+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:22.070 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:22.067+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:22.386 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:22.383+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:23.089 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:23.085+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:23.358 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:23.355+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:24.072 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:24.069+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:24.393 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:24.390+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:25.070 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:25.067+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:25.381 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:25.378+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:26.036 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:26.033+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:26.368 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:26.365+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:27.061 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:27.058+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:27.348 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:27.345+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:28.078 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:28.075+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:28.367 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:28.364+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:29.126 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:29.123+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:29.324 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:29.321+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:30.148 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:30.145+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:30.281 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:30.278+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:31.108 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:31.105+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:31.298 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:31.295+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:32.147 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:32.144+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:32.319 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:32.316+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:33.127 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:33.123+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:33.366 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:33.364+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:34.081 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:34.077+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:34.413 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:34.408+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:35.076 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:35.072+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:35.403 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:35.399+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:36.091 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:36.087+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:36.357 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:36.353+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:37.048 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:37.044+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:37.391 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:37.387+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:38.031 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:38.027+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:38.388 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:38.384+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:39.043 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:39.039+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:39.372 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:39.369+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:40.025 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:40.021+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:40.353 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:40.349+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:40.982 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:40.978+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:41.339 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:41.335+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:42.001 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:41.997+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:42.370 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:42.366+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:42.990 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:42.987+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:43.420 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:43.418+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:43.951 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:43.949+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:44.456 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:44.453+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:44.943 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:44.940+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:45.453 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:45.450+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:45.910 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:45.907+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:46.426 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:46.423+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:46.939 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:46.936+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:47.427 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:47.424+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:47.971 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:47.968+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:48.461 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:48.458+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:48.975 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:48.972+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:49.436 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:49.433+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:49.985 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:49.982+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:50.479 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:50.476+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:50.945 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:50.942+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:51.502 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:51.499+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:51.959 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:51.956+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:52.536 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:52.533+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:52.934 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:52.931+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:53.523 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:53.520+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:53.916 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:53.913+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:54.506 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:54.503+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:54.955 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:54.952+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:55.536 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:55.533+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:55.942 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:55.939+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:56.491 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:56.488+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:56.913 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:56.910+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:57.445 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:57.442+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:57.869 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:57.866+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:58.488 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:58.485+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:58.824 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:58.821+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:13:59.496 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:13:59.493+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:13:59.791 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:13:59.788+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:00.525 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:00.522+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:00.795 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:00.792+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:01.576 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:01.573+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:01.807 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:01.804+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:02.592 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:02.589+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:02.833 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:02.830+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:03.586 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:03.583+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:03.841 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:03.838+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:04.555 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:04.552+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:04.882 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:04.879+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:05.585 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:05.582+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:05.863 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:05.860+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:06.567 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:06.564+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:06.905 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:06.902+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:07.591 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:07.589+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:07.890 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:07.887+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:08.581 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:08.578+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:08.872 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:08.869+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:09.576 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:09.574+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:09.827 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:09.825+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:10.599 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:10.596+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:10.783 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:10.781+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:11.595 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:11.592+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:11.757 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:11.754+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:12.633 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:12.630+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:12.723 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:12.719+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:13.675 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:13.672+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:13.766 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:13.763+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:14.707 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:14.704+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:14.796 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:14.794+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:15.683 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:15.680+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:15.752 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:15.749+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:16.733 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:16.730+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:16.755 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:16.751+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:17.733 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:17.729+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:17.743 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:17.739+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:18.713 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:18.709+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:18.721 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:18.717+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:19.711 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:19.707+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:19.735 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:19.731+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:20.699 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:20.695+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:20.754 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:20.750+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:21.673 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:21.669+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:21.782 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:21.778+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:22.650 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:22.646+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:22.808 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:22.805+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:23.663 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:23.659+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:23.852 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:23.848+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:24.624 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:24.620+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:24.864 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:24.861+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:25.645 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:25.640+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:25.872 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:25.869+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:26.687 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:26.684+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:26.922 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:26.920+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:27.649 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:27.646+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:27.878 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:27.876+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:28.642 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:28.639+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:28.927 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:28.924+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:29.606 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:29.603+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:29.951 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:29.948+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:30.583 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:30.580+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:30.984 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:30.980+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:31.616 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:31.613+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:31.974 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:31.970+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:32.663 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:32.660+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:32.953 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:32.950+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:33.647 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:33.644+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:33.915 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:33.912+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:34.683 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:34.681+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:34.890 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:34.887+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:35.655 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:35.653+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:35.939 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:35.936+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:36.619 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:36.616+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:36.984 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:36.981+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:37.597 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:37.594+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:38.024 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:38.021+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:38.551 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:38.548+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:39.070 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:39.067+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:39.596 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:39.593+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:40.027 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:40.024+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:40.630 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:40.627+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:40.983 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:40.980+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:41.587 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:41.584+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:42.004 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:42.001+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:42.627 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:42.624+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:43.048 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:43.045+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:43.636 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:43.633+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:44.067 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:44.064+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:44.609 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:44.606+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:45.108 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:45.105+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:45.566 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:45.563+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:46.148 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:46.145+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:46.576 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:46.573+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:47.117 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:47.114+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:47.573 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:47.570+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:48.153 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:48.150+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:48.609 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:48.605+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:49.156 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:49.153+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:49.637 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:49.634+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:50.152 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:50.150+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:50.632 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:50.630+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:51.116 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:51.114+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:51.671 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:51.668+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:52.073 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:52.070+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:52.660 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:52.657+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:53.097 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:53.094+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:53.676 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:53.674+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:54.111 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:54.108+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:54.665 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:54.662+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:55.147 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:55.144+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:55.706 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:55.703+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:56.195 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:56.192+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:56.727 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:56.724+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:57.186 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:57.183+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:57.743 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:57.740+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:58.193 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:58.189+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:58.723 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:58.719+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:14:59.191 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:14:59.187+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:14:59.721 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:14:59.717+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:00.230 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:00.226+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:00.748 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:00.744+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:01.182 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:01.178+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:01.780 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:01.777+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:02.152 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:02.148+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:02.804 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:02.800+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:03.157 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:03.153+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:03.820 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:03.816+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:04.143 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:04.139+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:04.801 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:04.797+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:05.151 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:05.147+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:05.756 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:05.752+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:06.200 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:06.196+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:06.738 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:06.735+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:07.202 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:07.199+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:07.716 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:07.714+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:08.164 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:08.161+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:08.759 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:08.756+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:09.204 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:09.201+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:09.773 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:09.770+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:10.160 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:10.157+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:10.760 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:10.758+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:11.179 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:11.176+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:11.733 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:11.730+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:12.214 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:12.212+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:12.695 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:12.692+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:13.252 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:13.249+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:13.697 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:13.694+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:14.218 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:14.215+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:14.717 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:14.714+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:15.262 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:15.259+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:15.671 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:15.669+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:16.271 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:16.268+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:16.645 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:16.642+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:17.307 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:17.304+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:17.687 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:17.684+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:18.332 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:18.329+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:18.725 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:18.722+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:19.314 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:19.311+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:19.680 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:19.678+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:20.335 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:20.332+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:20.715 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:20.712+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:21.333 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:21.330+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:21.716 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:21.714+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:22.376 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:22.373+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:22.715 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:22.712+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:23.333 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:23.330+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:23.755 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:23.752+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:24.361 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:24.358+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:24.752 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:24.749+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:25.357 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:25.354+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:25.746 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:25.743+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:26.403 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:26.400+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:26.790 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:26.787+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:27.422 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:27.419+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:27.761 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:27.758+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:28.446 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:28.443+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:28.770 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:28.767+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:29.476 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:29.473+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:29.802 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:29.800+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:30.520 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:30.517+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:30.780 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:30.777+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:31.484 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:31.481+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:31.775 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:31.772+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:32.503 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:32.500+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:32.770 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:32.768+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:33.544 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:33.541+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:33.769 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:33.766+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:34.536 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:34.533+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:34.732 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:34.729+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:34.748 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T17:15:34.745+0000 7fa2aa2ce700 0 -- 172.21.15.123:0/1871504539 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x5638b44c5610 msgr2=0x7fa28c03b170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T17:15:35.538 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:35.535+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:35.705 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:35.702+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:36.552 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:36.549+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:36.746 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:36.743+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:37.571 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:37.568+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:37.699 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:37.696+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:38.613 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:38.610+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:38.735 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:38.732+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:39.565 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:39.563+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:39.706 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:39.703+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:40.592 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:40.588+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:40.735 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:40.731+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:41.621 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:41.616+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:41.751 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:41.747+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:42.637 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:42.633+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:42.749 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:42.745+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:43.595 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:43.592+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:43.780 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:43.776+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:44.628 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:44.624+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:44.814 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:44.810+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:45.612 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:45.608+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:45.771 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:45.767+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:46.654 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:46.650+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:46.773 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:46.770+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:47.667 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:47.663+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:47.775 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:47.771+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:48.706 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:48.702+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:48.760 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:48.756+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:49.692 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:49.689+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:49.788 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:49.785+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:50.700 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:50.697+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:50.805 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:50.802+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:51.747 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:51.744+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:51.806 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:51.803+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:52.727 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:52.724+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:52.758 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:52.756+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:53.748 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:53.679+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:53.782 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:53.779+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:54.648 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:54.645+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:54.789 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:54.786+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:55.628 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:55.625+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:55.750 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:55.747+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:56.595 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:56.592+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:56.797 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:56.794+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:57.579 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:57.577+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:57.814 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:57.811+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:58.571 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:58.568+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:58.790 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:58.787+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:15:59.536 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:15:59.533+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:15:59.777 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:15:59.774+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:00.536 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:00.533+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:00.755 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:00.752+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:01.522 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:01.519+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:01.747 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:01.745+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:02.556 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:02.553+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:02.784 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:02.781+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:03.603 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:03.600+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:03.821 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:03.818+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:04.573 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:04.571+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:04.804 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:04.801+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:05.550 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:05.547+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:05.835 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:05.833+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:06.524 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:06.521+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:06.831 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:06.829+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:07.502 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:07.499+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:07.839 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:07.837+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:08.519 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:08.516+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:08.812 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:08.809+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:09.517 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:09.514+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:09.811 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:09.808+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:10.470 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:10.467+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:10.794 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:10.791+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:11.463 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:11.461+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:11.782 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:11.779+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:12.420 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:12.417+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:12.820 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:12.817+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:13.418 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:13.415+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:13.854 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:13.851+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:14.430 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:14.427+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:14.843 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:14.841+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:15.440 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:15.437+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:15.872 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:15.869+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:16.400 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:16.397+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:16.868 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:16.865+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:17.422 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:17.420+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:17.861 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:17.859+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:18.389 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:18.387+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:18.899 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:18.895+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:19.345 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:19.342+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:19.876 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:19.874+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:20.309 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:20.306+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:20.836 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:20.833+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:21.282 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:21.279+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:21.833 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:21.831+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:22.244 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:22.241+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:22.853 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:22.848+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:23.264 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:23.260+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:23.900 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:23.896+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:24.245 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:24.241+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:24.925 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:24.922+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:25.229 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:25.225+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:25.892 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:25.888+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:26.198 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:26.195+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:26.877 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:26.873+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:27.221 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:27.217+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:27.828 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:27.824+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:28.220 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:28.216+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:28.821 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:28.818+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:29.240 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:29.236+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:29.789 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:29.785+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:30.254 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:30.250+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:30.774 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:30.770+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:31.246 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:31.242+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:31.778 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:31.774+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:32.248 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:32.245+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:32.822 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:32.819+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:33.225 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:33.223+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:33.810 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:33.807+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:34.209 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:34.206+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:34.856 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:34.853+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:35.208 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:35.205+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:35.866 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:35.863+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:36.190 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:36.187+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:36.873 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:36.870+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:37.218 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:37.215+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:37.909 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:37.906+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:38.180 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:38.177+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:38.936 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:38.933+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:39.138 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:39.135+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:39.888 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:39.885+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:40.112 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:40.110+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:40.851 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:40.848+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:41.154 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:41.151+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:41.892 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:41.889+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:42.112 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:42.109+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:42.906 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:42.903+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:43.083 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:43.080+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:43.871 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:43.868+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:44.065 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:44.062+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:44.915 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:44.913+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:45.044 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:45.041+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:45.890 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:45.887+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:46.074 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:46.072+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:46.852 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:46.849+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:47.050 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:47.047+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:47.841 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:47.838+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:48.023 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:48.020+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:48.873 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:48.870+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:49.042 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:49.039+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:49.856 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:49.853+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:50.019 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:50.017+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:50.894 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:50.891+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:51.025 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:51.022+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:51.930 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:51.927+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:52.067 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:52.064+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:52.923 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:52.921+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:53.043 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:53.040+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:53.888 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:53.885+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:54.011 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:54.008+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:54.893 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:54.890+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:55.010 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:55.008+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:55.908 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:55.905+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:55.970 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:55.967+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:56.886 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:56.883+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:57.010 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:57.007+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:57.841 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:57.839+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:58.037 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:58.033+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:58.859 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:58.853+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:59.004 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:59.001+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:16:59.873 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:16:59.870+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:16:59.982 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:16:59.980+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:00.869 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:00.867+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:00.945 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:00.942+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:01.831 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:01.827+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:01.916 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:01.913+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:02.811 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:02.808+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:02.878 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:02.875+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:03.831 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:03.828+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:03.902 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:03.899+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:04.816 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:04.812+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:04.922 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:04.918+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:05.847 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:05.844+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:05.901 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:05.897+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:06.826 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:06.823+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:06.930 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:06.926+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:07.811 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:07.807+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:07.977 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:07.974+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:08.812 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:08.809+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:08.973 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:08.970+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:09.814 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:09.811+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:09.998 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:09.994+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:10.815 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:10.811+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:11.029 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:11.025+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:11.863 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:11.859+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:12.035 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:12.032+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:12.883 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:12.879+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:13.045 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:13.041+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:13.871 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:13.869+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:14.087 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:14.085+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:14.828 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:14.825+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:15.131 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:15.129+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:15.813 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:15.810+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:16.178 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:16.175+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:16.844 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:16.841+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:17.147 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:17.144+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:17.870 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:17.867+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:18.197 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:18.194+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:18.845 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:18.842+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:19.157 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:19.155+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:19.833 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:19.830+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:20.139 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:20.137+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:20.865 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:20.862+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:21.162 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:21.159+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:21.889 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:21.886+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:22.167 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:22.165+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:22.926 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:22.923+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:23.148 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:23.145+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:23.960 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:23.957+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:24.185 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:24.182+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:24.959 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:24.956+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:25.192 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:25.189+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:25.922 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:25.919+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:26.167 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:26.164+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:26.933 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:26.931+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:27.215 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:27.213+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:27.933 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:27.930+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:28.199 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:28.197+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:28.973 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:28.970+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:29.186 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:29.183+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:29.983 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:29.981+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:30.235 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:30.233+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:30.988 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:30.985+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:31.265 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:31.262+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:31.981 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:31.979+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:32.254 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:32.251+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:32.937 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:32.935+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:33.221 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:33.218+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:33.924 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:33.921+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:34.224 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:34.222+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:34.936 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:34.933+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:35.190 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:35.187+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:35.913 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:35.911+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:36.227 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:36.224+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:36.888 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:36.885+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:37.190 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:37.187+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:37.901 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:37.898+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:38.169 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:38.165+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:38.947 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:38.944+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:39.132 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:39.129+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:39.987 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:39.984+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:40.119 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:40.116+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:41.002 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:40.999+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:41.083 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:41.081+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:42.025 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:42.022+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:42.054 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:42.051+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:43.039 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:43.037+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:43.044 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:43.041+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:44.025 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:44.022+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:44.037 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:44.035+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:45.013 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:45.011+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:45.047 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:45.045+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:46.005 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:46.003+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:46.030 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:46.027+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:46.975 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:46.971+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:47.076 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:47.072+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:47.956 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:47.952+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:48.102 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:48.098+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:48.992 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:48.989+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:49.099 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:49.096+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:50.009 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:50.005+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:50.125 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:50.121+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:51.014 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:51.010+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:51.142 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:51.138+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:51.975 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:51.972+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:52.186 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:52.183+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:52.936 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:52.932+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:53.205 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:53.201+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:53.983 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:53.980+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:54.169 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:54.165+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:55.001 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:54.998+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:55.135 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:55.132+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:56.046 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:56.043+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:56.121 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:56.118+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:57.019 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:57.017+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:57.082 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:57.080+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:58.061 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:58.058+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:58.067 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:58.064+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:17:59.033 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:17:59.030+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:17:59.053 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:17:59.050+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:00.020 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:00.018+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:00.053 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:00.051+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:01.008 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:01.006+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:01.076 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:01.074+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:02.017 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:02.014+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:02.057 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:02.054+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:03.027 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:03.024+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:03.028 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:03.025+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:03.988 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:03.986+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:03.994 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:03.991+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:04.999 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:04.996+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:05.030 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:05.027+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:05.959 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:05.957+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:05.995 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:05.992+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:06.979 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:06.976+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:06.984 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:06.981+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:07.950 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:07.947+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:08.026 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:08.023+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:08.904 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:08.901+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:09.073 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:09.070+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:09.879 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:09.876+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:10.030 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:10.027+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:10.927 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:10.924+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:11.029 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:11.026+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:11.879 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:11.876+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:12.079 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:12.077+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:12.849 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:12.846+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:13.126 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:13.123+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:13.848 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:13.845+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:14.117 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:14.114+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:14.805 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:14.802+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:15.146 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:15.143+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:15.804 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:15.802+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:16.145 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:16.143+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:16.841 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:16.837+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:17.184 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:17.181+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:17.798 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:17.796+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:18.227 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:18.224+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:18.780 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:18.777+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:19.202 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:19.199+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:19.805 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:19.802+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:20.237 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:20.235+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:20.804 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:20.801+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:21.203 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:21.200+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:21.848 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:21.846+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:22.229 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:22.227+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:22.810 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:22.807+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:23.261 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:23.258+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:23.843 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:23.840+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:24.235 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:24.232+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:24.834 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:24.832+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:25.249 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:25.247+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:25.863 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:25.860+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:26.298 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:26.295+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:26.841 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:26.838+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:27.332 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:27.330+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:27.831 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:27.828+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:28.366 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:28.364+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:28.829 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:28.826+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:29.334 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:29.330+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:29.789 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:29.786+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:30.286 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:30.283+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:30.773 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:30.769+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:31.309 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:31.305+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:31.757 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:31.753+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:32.302 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:32.298+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:32.762 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:32.758+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:33.292 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:33.288+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:33.795 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:33.791+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:34.324 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:34.320+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:34.828 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:34.824+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:35.282 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:35.278+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:35.876 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:35.873+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:36.292 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:36.288+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:36.840 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:36.835+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:37.290 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:37.287+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:37.818 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:37.815+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:38.319 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:38.317+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:38.851 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:38.848+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:39.347 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:39.344+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:39.873 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:39.870+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:40.380 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:40.378+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:40.847 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:40.845+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:41.422 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:41.419+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:41.880 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:41.878+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:42.398 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:42.396+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:42.881 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:42.878+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:43.382 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:43.379+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:43.905 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:43.902+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:44.426 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:44.423+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:44.913 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:44.910+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:45.406 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:45.403+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:45.940 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:45.938+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:46.391 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:46.389+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:46.935 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:46.932+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:47.360 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:47.357+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:47.982 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:47.980+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:48.375 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:48.373+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:49.009 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:49.007+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:49.363 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:49.361+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:50.032 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:50.029+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:50.343 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:50.340+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:51.016 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:51.013+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:51.383 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:51.381+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:52.062 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:52.060+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:52.352 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:52.349+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:53.030 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:53.027+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:53.338 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:53.335+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:54.010 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:54.007+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:54.310 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:54.307+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:55.000 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:54.997+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:55.273 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:55.271+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:56.026 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:56.024+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:56.265 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:56.262+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:57.062 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:57.060+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:57.239 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:57.236+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:58.087 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:58.082+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:58.260 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:58.257+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:18:59.075 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:18:59.072+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:18:59.218 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:18:59.215+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:00.105 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:00.102+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:00.265 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:00.262+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:01.104 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:01.101+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:01.251 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:01.249+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:02.153 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:02.151+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:02.267 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:02.265+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:03.107 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:03.105+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:03.258 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:03.256+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:04.145 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:04.142+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:04.292 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:04.290+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:05.129 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:05.127+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:05.285 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:05.282+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:06.166 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:06.163+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:06.316 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:06.313+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:07.129 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:07.127+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:07.308 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:07.305+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:08.139 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:08.136+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:08.308 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:08.305+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:09.163 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:09.160+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:09.280 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:09.277+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:10.177 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:10.174+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:10.317 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:10.315+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:11.196 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:11.194+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:11.337 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:11.335+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:12.224 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:12.220+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:12.291 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:12.287+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:13.268 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:13.265+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:13.273 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:13.270+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:14.269 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:14.265+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:14.312 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:14.308+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:15.261 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:15.257+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:15.332 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:15.328+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:16.286 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:16.282+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:16.297 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:16.293+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:17.265 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:17.261+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:17.327 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:17.323+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:18.249 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:18.244+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:18.292 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:18.289+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:19.246 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:19.242+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:19.263 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:19.260+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:20.279 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:20.277+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:20.283 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:20.281+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:21.250 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:21.248+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:21.273 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:21.270+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:22.267 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:22.265+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:22.281 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:22.278+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:23.249 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:23.246+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:23.252 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:23.250+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:24.205 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:24.203+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:24.287 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:24.285+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:25.230 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:25.228+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:25.242 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:25.240+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:26.213 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:26.210+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:26.252 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:26.250+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:27.221 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:27.218+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:27.243 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:27.240+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:28.209 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:28.206+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:28.262 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:28.260+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:29.210 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:29.207+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:29.260 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:29.257+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:30.228 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:30.225+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:30.251 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:30.248+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:31.258 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:31.255+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:31.270 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:31.268+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:32.248 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:32.246+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:32.314 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:32.312+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:33.239 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:33.236+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:33.310 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:33.308+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:34.258 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:34.256+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:34.321 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:34.318+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:35.254 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:35.251+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:35.313 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:35.310+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:36.299 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:36.296+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:36.337 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:36.335+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:37.280 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:37.277+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:37.337 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:37.333+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:38.306 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:38.303+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:38.346 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:38.344+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:39.291 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:39.288+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:39.320 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:39.318+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:40.270 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:40.268+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:40.354 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:40.351+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:41.297 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:41.294+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:41.343 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:41.340+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:42.267 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:42.265+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:42.356 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:42.353+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:43.253 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:43.250+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:43.348 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:43.346+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:44.265 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:44.262+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:44.346 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:44.343+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:45.234 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:45.230+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:45.362 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:45.360+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:46.215 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:46.212+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:46.330 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:46.328+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:47.223 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:47.220+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:47.340 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:47.338+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:48.253 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:48.251+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:48.341 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:48.338+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:49.268 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:49.266+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:49.350 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:49.348+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:50.280 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:50.278+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:50.326 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:50.324+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:51.283 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:51.280+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:51.308 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:51.306+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:52.273 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:52.270+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:52.307 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:52.304+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:53.261 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:53.258+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:53.298 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:53.295+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:54.242 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:54.239+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:54.249 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:54.246+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:55.235 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:55.231+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:55.255 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:55.251+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:56.227 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:56.224+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:56.253 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:56.250+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:57.231 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:57.227+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:57.272 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:57.268+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:58.245 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:58.242+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:58.303 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:58.299+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:19:59.230 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:19:59.227+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:19:59.319 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:19:59.315+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:00.243 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:00.239+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:00.354 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:00.351+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:01.227 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:01.223+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:01.332 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:01.329+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:02.191 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:02.187+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:02.324 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:02.321+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:03.199 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:03.197+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:03.340 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:03.337+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:04.239 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:04.237+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:04.382 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:04.379+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:05.237 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:05.235+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:05.430 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:05.427+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:06.196 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:06.193+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:06.413 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:06.410+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:07.196 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:07.194+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:07.386 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:07.384+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:08.218 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:08.215+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:08.394 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:08.391+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:09.232 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:09.229+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:09.434 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:09.431+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:10.258 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:10.255+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:10.468 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:10.465+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:11.271 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:11.269+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:11.495 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:11.492+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:12.298 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:12.295+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:12.455 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:12.452+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:13.321 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:13.318+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:13.443 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:13.441+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:14.317 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:14.315+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:14.444 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:14.442+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:15.321 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:15.319+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:15.461 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:15.458+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:16.290 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:16.287+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:16.460 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:16.457+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:17.328 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:17.325+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:17.441 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:17.439+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:18.357 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:18.354+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:18.437 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:18.434+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:19.337 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:19.334+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:19.461 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:19.459+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:20.299 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:20.296+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:20.488 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:20.485+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:21.296 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:21.293+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:21.503 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:21.500+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:22.279 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:22.277+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:22.497 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:22.494+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:23.273 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:23.270+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:23.450 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:23.447+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:24.301 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:24.298+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:24.431 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:24.429+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:25.299 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:25.296+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:25.407 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:25.405+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:26.347 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:26.345+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:26.455 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:26.452+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:27.326 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:27.323+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:27.502 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:27.499+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:28.364 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:28.361+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:28.545 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:28.542+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:29.357 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:29.355+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:29.557 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:29.555+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:30.345 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:30.342+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:30.607 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:30.605+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:31.387 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:31.385+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:31.561 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:31.558+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:32.426 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:32.423+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:32.583 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:32.581+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:33.417 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:33.415+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:33.578 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:33.576+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:34.387 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:34.384+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:34.583 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:34.580+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:35.375 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:35.372+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:35.573 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:35.570+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:36.390 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:36.386+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:36.530 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:36.526+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:37.437 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:37.433+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:37.506 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:37.503+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:38.458 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:38.454+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:38.536 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:38.532+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:39.435 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:39.431+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:39.507 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:39.503+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:40.436 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:40.432+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:40.518 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:40.514+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:41.448 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:41.445+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:41.476 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:41.472+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:42.495 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:42.491+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:42.520 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:42.517+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:43.491 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:43.488+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:43.519 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:43.516+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:44.446 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:44.443+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:44.521 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:44.515+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:45.484 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:45.481+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:45.506 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:45.504+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:46.495 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:46.492+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:46.528 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:46.525+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:47.499 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:47.496+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:47.572 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:47.569+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:48.482 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:48.480+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:48.597 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:48.594+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:49.454 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:49.451+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:49.606 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:49.604+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:50.492 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:50.490+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:50.583 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:50.580+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:51.526 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:51.524+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:51.554 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:51.551+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:52.532 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:52.529+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:52.572 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:52.569+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:53.522 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:53.520+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:53.584 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:53.581+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:54.558 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:54.556+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:54.564 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:54.561+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:55.525 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:55.522+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:55.609 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:55.607+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:56.502 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:56.500+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:56.582 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:56.579+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:57.543 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:57.540+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:57.594 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:57.591+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:58.498 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:58.496+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:58.622 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:58.619+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:20:59.514 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:20:59.511+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:20:59.627 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:20:59.624+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:00.506 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:00.504+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:00.584 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:00.582+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:01.524 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:01.521+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:01.565 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:01.562+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:02.567 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:02.565+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:02.604 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:02.601+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:03.579 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:03.576+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:03.603 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:03.600+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:04.562 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:04.559+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:04.597 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:04.594+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:05.591 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:05.589+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:05.599 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:05.596+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:06.610 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:06.607+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:06.619 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:06.616+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:07.571 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:07.569+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:07.666 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:07.663+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:08.577 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:08.574+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:08.681 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:08.678+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:09.607 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:09.604+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:09.693 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:09.690+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:10.631 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:10.628+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:10.680 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:10.678+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:11.621 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:11.619+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:11.635 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:11.632+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:12.653 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:12.650+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:12.680 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:12.678+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:13.608 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:13.606+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:13.678 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:13.675+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:14.584 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:14.581+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:14.716 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:14.713+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:15.593 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:15.591+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:15.681 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:15.678+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:16.600 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:16.597+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:16.730 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:16.727+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:17.557 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:17.555+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:17.699 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:17.697+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:18.555 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:18.551+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:18.680 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:18.676+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:19.546 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:19.542+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:19.635 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:19.632+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:20.564 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:20.560+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:20.644 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:20.640+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:21.599 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:21.595+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:21.621 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:21.618+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:22.649 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:22.646+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:22.669 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:22.664+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:23.677 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:23.673+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:23.697 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:23.693+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:24.656 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:24.652+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:24.663 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:24.660+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:25.647 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:25.643+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:25.658 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:25.655+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:26.604 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:26.600+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:26.685 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:26.681+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:27.580 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:27.578+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:27.724 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:27.722+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:28.591 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:28.589+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:28.689 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:28.686+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:29.585 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:29.583+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:29.703 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:29.700+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:30.631 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:30.629+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:30.665 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:30.662+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:31.613 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:31.610+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:31.616 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:31.613+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:32.581 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:32.579+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:32.664 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:32.661+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:33.594 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:33.591+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:33.709 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:33.707+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:34.581 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:34.577+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:34.677 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:34.675+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:35.585 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:35.583+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:35.701 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:35.699+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:36.569 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:36.567+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:36.678 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:36.676+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:37.593 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:37.591+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:37.694 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:37.691+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:38.590 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:38.587+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:38.684 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:38.681+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:39.602 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:39.599+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:39.663 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:39.660+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:40.648 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:40.645+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:40.665 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:40.663+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:41.659 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:41.656+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:41.698 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:41.695+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:42.693 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:42.690+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:42.742 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:42.739+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:43.671 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:43.669+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:43.787 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:43.784+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:44.670 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:44.667+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:44.832 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:44.830+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:45.702 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:45.700+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:45.817 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:45.815+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:46.701 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:46.698+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:46.818 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:46.816+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:47.714 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:47.712+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:47.795 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:47.793+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:48.684 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:48.681+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:48.819 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:48.816+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:49.720 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:49.717+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:49.809 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:49.806+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:50.716 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:50.714+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:50.826 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:50.824+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:51.710 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:51.708+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:51.835 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:51.833+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:52.761 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:52.758+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:52.860 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:52.857+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:53.737 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:53.735+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:53.910 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:53.907+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:54.715 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:54.713+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:54.915 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:54.912+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:55.679 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:55.677+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:55.963 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:55.961+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:56.634 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:56.631+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:56.951 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:56.948+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:57.659 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:57.657+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:57.921 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:57.919+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:58.676 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:58.673+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:58.897 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:58.895+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:21:59.694 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:21:59.691+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:21:59.854 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:21:59.851+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:00.744 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:00.741+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:00.903 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:00.900+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:01.782 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:01.779+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:01.943 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:01.939+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:02.824 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:02.820+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:02.988 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:02.984+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:03.784 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:03.780+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:04.024 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:04.020+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:04.739 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:04.736+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:05.005 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:05.001+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:05.721 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:05.718+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:06.011 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:06.007+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:06.679 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:06.675+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:06.968 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:06.964+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:07.693 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:07.690+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:07.934 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:07.930+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:08.716 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:08.713+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:08.917 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:08.914+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:09.760 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:09.757+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:09.908 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:09.906+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:10.765 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:10.762+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:10.923 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:10.921+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:11.792 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:11.789+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:11.903 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:11.900+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:12.804 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:12.801+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:12.941 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:12.938+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:13.794 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:13.791+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:13.971 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:13.968+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:14.745 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:14.742+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:14.956 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:14.954+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:15.783 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:15.780+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:15.993 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:15.991+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:16.830 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:16.827+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:16.957 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:16.954+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:17.824 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:17.822+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:18.000 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:17.997+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:18.862 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:18.859+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:19.009 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:19.007+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:19.826 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:19.823+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:19.989 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:19.986+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:20.850 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:20.847+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:21.000 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:20.997+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:21.879 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:21.876+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:22.024 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:22.022+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:22.892 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:22.889+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:22.979 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:22.977+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:23.906 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:23.904+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:24.002 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:24.000+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:24.890 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:24.887+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:25.010 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:25.008+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:25.846 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:25.843+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:26.047 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:26.045+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:26.861 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:26.858+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:27.071 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:27.069+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:27.871 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:27.869+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:28.117 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:28.114+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:28.909 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:28.907+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:29.085 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:29.083+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:29.895 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:29.892+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:30.077 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:30.074+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:30.875 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:30.872+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:31.036 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:31.033+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:31.850 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:31.847+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:32.032 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:32.029+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:32.838 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:32.835+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:33.078 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:33.076+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:33.870 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:33.867+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:34.040 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:34.038+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:34.887 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:34.884+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:35.086 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:35.083+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:35.934 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:35.932+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:36.075 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:36.073+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:36.950 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:36.948+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:37.088 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:37.085+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:37.981 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:37.979+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:38.131 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:38.128+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:39.014 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:39.012+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:39.161 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:39.158+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:40.041 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:40.038+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:40.173 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:40.171+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:41.013 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:41.010+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:41.223 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:41.221+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:41.964 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:41.961+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:42.231 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:42.228+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:42.993 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:42.989+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:43.275 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:43.271+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:44.029 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:44.025+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:44.260 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:44.257+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:45.050 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:45.046+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:45.229 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:45.225+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:46.013 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:46.010+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:46.213 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:46.209+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:46.994 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:46.991+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:47.204 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:47.201+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:48.037 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:48.034+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:48.164 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:48.160+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:49.070 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:49.066+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:49.149 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:49.145+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:50.036 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:50.033+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:50.171 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:50.168+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:51.068 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:51.065+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:51.217 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:51.213+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:52.083 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:52.081+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:52.217 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:52.215+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:53.093 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:53.091+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:53.193 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:53.190+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:54.138 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:54.135+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:54.200 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:54.197+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:55.103 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:55.100+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:55.208 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:55.206+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:56.065 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:56.062+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:56.236 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:56.233+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:57.101 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:57.098+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:57.227 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:57.225+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:58.148 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:58.146+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:58.192 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:58.189+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:22:59.177 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:22:59.175+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:22:59.242 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:22:59.240+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:00.176 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:00.173+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:00.217 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:00.215+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:01.191 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:01.189+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:01.254 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:01.252+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:02.161 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:02.158+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:02.254 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:02.251+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:03.192 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:03.189+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:03.233 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:03.230+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:04.168 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:04.166+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:04.283 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:04.280+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:05.134 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:05.131+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:05.236 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:05.233+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:06.091 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:06.088+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:06.207 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:06.204+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:07.122 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:07.120+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:07.166 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:07.164+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:08.078 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:08.076+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:08.203 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:08.200+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:09.038 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:09.035+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:09.160 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:09.158+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:10.067 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:10.064+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:10.145 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:10.143+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:11.104 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:11.102+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:11.167 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:11.164+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:12.102 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:12.098+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:12.168 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:12.165+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:13.136 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:13.133+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:13.166 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:13.163+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:14.129 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:14.126+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:14.177 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:14.175+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:15.173 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:15.171+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:15.224 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:15.221+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:16.147 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:16.144+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:16.178 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:16.175+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:17.150 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:17.146+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:17.209 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:17.207+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:18.100 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:18.098+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:18.191 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:18.188+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:19.092 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:19.090+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:19.200 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:19.197+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:20.118 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:20.116+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:20.163 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:20.160+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:21.083 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:21.080+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:21.117 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:21.115+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:22.096 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:22.094+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:22.124 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:22.121+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:23.103 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:23.101+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:23.136 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:23.134+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:24.132 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:24.129+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:24.174 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:24.171+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:25.117 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:25.114+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:25.132 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:25.130+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:26.151 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:26.147+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:26.167 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:26.163+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:27.162 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:27.158+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:27.197 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:27.193+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:28.179 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:28.175+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:28.189 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:28.186+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:29.131 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:29.127+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:29.182 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:29.179+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:30.144 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:30.141+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:30.195 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:30.191+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:31.184 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:31.180+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:31.193 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:31.189+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:32.223 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:32.220+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:32.226 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:32.223+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:33.186 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:33.182+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:33.251 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:33.249+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:34.189 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:34.185+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:34.255 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:34.252+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:35.217 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:35.215+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:35.279 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:35.277+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:36.201 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:36.198+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:36.259 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:36.257+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:37.237 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:37.234+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:37.250 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:37.247+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:38.196 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:38.194+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:38.220 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:38.218+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:39.212 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:39.209+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:39.271 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:39.268+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:40.208 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:40.205+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:40.320 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:40.317+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:41.239 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:41.236+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:41.319 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:41.316+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:42.272 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:42.269+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:42.339 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:42.336+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:43.236 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:43.234+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:43.386 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:43.384+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:44.240 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:44.237+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:44.358 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:44.354+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:45.232 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:45.229+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:45.362 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:45.359+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:46.205 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:46.202+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:46.398 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:46.396+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:47.196 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:47.194+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:47.390 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:47.387+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:48.172 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:48.169+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:48.359 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:48.356+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:49.162 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:49.159+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:49.384 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:49.381+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:50.165 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:50.163+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:50.373 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:50.370+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:51.195 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:51.192+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:51.389 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:51.387+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:52.162 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:52.160+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:52.408 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:52.406+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:53.127 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:53.125+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:53.452 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:53.449+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:54.119 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:54.116+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:54.476 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:54.474+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:55.110 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:55.108+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:55.481 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:55.479+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:56.110 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:56.108+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:56.460 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:56.457+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:57.116 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:57.113+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:57.480 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:57.478+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:58.120 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:58.117+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:58.494 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:58.491+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:23:59.081 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:23:59.078+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:23:59.521 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:23:59.519+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:00.102 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:00.099+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:00.536 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:00.534+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:01.075 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:01.072+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:01.563 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:01.561+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:02.051 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:02.048+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:02.519 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:02.517+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:03.027 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:03.024+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:03.542 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:03.539+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:04.043 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:04.040+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:04.572 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:04.570+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:05.050 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:05.047+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:05.542 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:05.540+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:06.036 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:06.034+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:06.574 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:06.571+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:07.052 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:07.050+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:07.595 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:07.592+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:08.079 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:08.076+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:08.576 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:08.573+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:09.054 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:09.050+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:09.624 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:09.620+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:10.045 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:10.041+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:10.628 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:10.625+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:11.013 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:11.009+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:11.601 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:11.597+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:12.044 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:12.040+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:12.635 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:12.631+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:13.089 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:13.086+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:13.681 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:13.677+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:14.105 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:14.102+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:14.726 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:14.723+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:15.058 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:15.055+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:15.773 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:15.769+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:16.045 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:16.041+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:16.783 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:16.780+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:17.020 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:17.016+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:17.813 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:17.811+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:18.025 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:18.023+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:18.847 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:18.844+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:18.990 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:18.987+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:19.871 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:19.869+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:19.963 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:19.960+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:20.840 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:20.837+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:20.968 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:20.966+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:21.871 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:21.868+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:21.940 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:21.937+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:22.867 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:22.864+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:22.938 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:22.936+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:23.907 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:23.905+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:23.983 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:23.980+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:24.860 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:24.857+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:24.956 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:24.953+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:25.820 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:25.817+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:25.985 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:25.983+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:26.845 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:26.843+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:26.937 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:26.935+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:27.867 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:27.864+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:27.892 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:27.890+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:28.879 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:28.876+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:28.881 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:28.879+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:29.858 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:29.855+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:29.870 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:29.868+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:30.828 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:30.826+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:30.919 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:30.916+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:31.839 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:31.837+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:31.881 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:31.879+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:32.888 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:32.885+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:32.914 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:32.911+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:33.839 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:33.837+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:33.871 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:33.868+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:34.809 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:34.806+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:34.907 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:34.904+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:35.803 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:35.800+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:35.941 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:35.939+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:36.831 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:36.829+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:36.949 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:36.946+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:37.836 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:37.833+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:37.961 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:37.959+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:38.787 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:38.785+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:38.976 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:38.973+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:39.792 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:39.789+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:39.937 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:39.935+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:40.828 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:40.825+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:40.965 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:40.963+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:41.805 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:41.802+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:41.987 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:41.984+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:42.825 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:42.823+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:43.025 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:43.023+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:43.869 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:43.867+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:44.022 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:44.020+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:44.853 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:44.850+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:44.973 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:44.971+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:45.860 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:45.858+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:45.974 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:45.971+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:46.881 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:46.878+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:46.954 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:46.952+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:47.876 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:47.874+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:47.996 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:47.994+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:48.833 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:48.830+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:49.002 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:48.999+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:49.837 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:49.834+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:50.039 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:50.037+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:50.843 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:50.840+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:51.005 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:51.002+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:51.844 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:51.840+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:51.963 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:51.960+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:52.881 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:52.877+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:52.920 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:52.916+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:53.837 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:53.834+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:53.903 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:53.900+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:54.797 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:54.793+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:54.890 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:54.886+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:55.827 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:55.824+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:55.849 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:55.846+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:56.806 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:56.802+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:56.855 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:56.852+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:57.813 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:57.809+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:57.840 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:57.836+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:58.806 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:58.803+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:58.831 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:58.828+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:24:59.791 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:24:59.787+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:24:59.818 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:24:59.815+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:00.748 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:00.745+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:00.779 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:00.777+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:01.746 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:01.744+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:01.779 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:01.776+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:02.705 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:02.703+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:02.829 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:02.826+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:03.739 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:03.736+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:03.817 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:03.814+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:04.767 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:04.765+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:04.851 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:04.849+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:05.791 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:05.789+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:05.855 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:05.853+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:06.811 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:06.808+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:06.849 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:06.847+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:07.790 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:07.787+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:07.824 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:07.822+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:08.763 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:08.761+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:08.838 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:08.836+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:09.786 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:09.784+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:09.794 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:09.791+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:10.764 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:10.762+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:10.806 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:10.804+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:11.756 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:11.753+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:11.797 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:11.794+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:12.715 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:12.713+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:12.798 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:12.796+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:13.721 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:13.718+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:13.795 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:13.792+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:14.757 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:14.755+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:14.775 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:14.773+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:15.759 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:15.756+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:15.816 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:15.813+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:16.733 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:16.731+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:16.781 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:16.779+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:17.686 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:17.683+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:17.739 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:17.737+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:18.701 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:18.699+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:18.727 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:18.724+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:19.695 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:19.692+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:19.711 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:19.709+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:20.652 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:20.650+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:20.752 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:20.750+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:21.674 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:21.672+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:21.765 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:21.763+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:22.688 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:22.686+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:22.744 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:22.742+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:23.717 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:23.714+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:23.723 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:23.721+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:24.674 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:24.672+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:24.707 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:24.705+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:25.690 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:25.687+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:25.713 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:25.710+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:26.665 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:26.663+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:26.739 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:26.737+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:27.655 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:27.653+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:27.750 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:27.747+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:28.621 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:28.619+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:28.797 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:28.795+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:29.581 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:29.579+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:29.797 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:29.795+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:30.603 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:30.601+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:30.827 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:30.825+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:31.621 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:31.618+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:31.795 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:31.793+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:32.619 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:32.617+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:32.828 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:32.825+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:33.668 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:33.665+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:33.829 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:33.825+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:34.687 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:34.684+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:34.810 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:34.806+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:35.692 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:35.688+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:35.787 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:35.784+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:36.650 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:36.646+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:36.787 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:36.784+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:37.699 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:37.696+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:37.747 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:37.744+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:38.703 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:38.700+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:38.780 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:38.777+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:39.681 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:39.677+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:39.819 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:39.816+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:40.719 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:40.715+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:40.868 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:40.864+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:41.716 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:41.714+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:41.878 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:41.874+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:42.751 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:42.747+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:42.902 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:42.900+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:43.709 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:43.706+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:43.903 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:43.900+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:44.703 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:44.700+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:44.915 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:44.913+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:45.731 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:45.728+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:45.900 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:45.898+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:46.778 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:46.775+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:46.895 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:46.892+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:47.817 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:47.815+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:47.923 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:47.921+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:48.819 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:48.816+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:48.961 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:48.959+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:49.807 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:49.804+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:49.994 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:49.992+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:50.813 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:50.811+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:51.014 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:51.012+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:51.853 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:51.850+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:52.016 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:52.014+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:52.816 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:52.814+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:53.057 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:53.054+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:53.799 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:53.796+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:54.030 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:54.028+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:54.777 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:54.774+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:55.054 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:55.052+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:55.795 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:55.793+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:56.062 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:56.059+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:56.832 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:56.829+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:57.096 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:57.094+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:57.821 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:57.818+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:58.065 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:58.062+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:58.810 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:58.808+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:25:59.071 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:25:59.068+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:25:59.780 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:25:59.777+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:00.031 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:00.029+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:00.741 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:00.738+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:01.068 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:01.066+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:01.750 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:01.747+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:02.107 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:02.104+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:02.731 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:02.729+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:03.062 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:03.060+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:03.757 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:03.754+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:04.036 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:04.033+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:04.728 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:04.725+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:05.064 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:05.061+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:05.734 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:05.732+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:06.072 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:06.070+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:06.701 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:06.696+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:07.034 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:07.032+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:07.732 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:07.729+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:08.066 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:08.064+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:08.741 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:08.738+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:09.052 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:09.049+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:09.780 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:09.777+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:10.047 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:10.045+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:10.809 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:10.806+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:11.050 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:11.048+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:11.811 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:11.808+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:12.047 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:12.044+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:12.767 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:12.764+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:13.091 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:13.088+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:13.808 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:13.805+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:14.071 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:14.069+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:14.803 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:14.801+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:15.048 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:15.045+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:15.813 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:15.811+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:16.009 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:16.006+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:16.828 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:16.825+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:16.996 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:16.993+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:17.796 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:17.793+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:18.000 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:17.996+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:18.825 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:18.821+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:19.023 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:19.019+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:19.821 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:19.817+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:20.004 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:20.001+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:20.783 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:20.780+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:20.963 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:20.959+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:21.778 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:21.774+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:21.923 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:21.919+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:22.795 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:22.791+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:22.956 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:22.953+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:23.830 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:23.826+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:24.006 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:24.003+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:24.790 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:24.786+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:24.962 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:24.958+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:25.803 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:25.801+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:25.975 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:25.972+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:26.765 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:26.763+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:26.944 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:26.941+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:27.763 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:27.761+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:27.944 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:27.941+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:28.761 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:28.759+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:28.914 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:28.912+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:29.729 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:29.727+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:29.956 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:29.953+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:30.715 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:30.712+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:30.997 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:30.995+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:31.730 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:31.727+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:32.031 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:32.029+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:32.769 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:32.766+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:33.000 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:32.998+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:33.771 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:33.768+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:33.963 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:33.961+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:34.769 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:34.766+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:34.943 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:34.941+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:35.768 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:35.765+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:35.984 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:35.982+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:36.726 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:36.723+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:37.008 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:37.005+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:37.757 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:37.755+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:37.967 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:37.964+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:38.789 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:38.787+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:39.008 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:39.006+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:39.742 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:39.739+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:40.022 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:40.019+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:40.738 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:40.736+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:41.070 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:41.067+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:41.715 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:41.712+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:42.055 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:42.053+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:42.763 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:42.760+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:43.073 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:43.071+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:43.765 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:43.762+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:44.038 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:44.036+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:44.812 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:44.810+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:44.998 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:44.996+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:45.775 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:45.772+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:45.993 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:45.990+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:46.783 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:46.780+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:46.947 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:46.945+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:47.832 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:47.830+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:47.978 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:47.975+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:48.790 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:48.787+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:48.936 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:48.933+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:49.750 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:49.747+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:49.959 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:49.957+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:50.775 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:50.772+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:50.999 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:50.996+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:51.810 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:51.808+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:51.964 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:51.961+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:52.855 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:52.849+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:52.993 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:52.990+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:53.885 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:53.881+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:54.025 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:54.020+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:54.915 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:54.912+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:55.042 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:55.040+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:55.875 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:55.873+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:56.083 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:56.080+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:56.831 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:56.828+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:57.087 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:57.084+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:57.793 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:57.790+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:58.128 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:58.125+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:58.789 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:58.786+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:26:59.117 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:26:59.115+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:26:59.829 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:26:59.826+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:00.113 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:00.110+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:00.820 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:00.817+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:01.124 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:01.121+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:01.790 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:01.787+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:02.149 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:02.146+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:02.787 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:02.784+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:03.192 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:03.189+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:03.833 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:03.829+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:04.178 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:04.175+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:04.839 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:04.836+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:05.212 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:05.208+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:05.808 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:05.805+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:06.193 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:06.189+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:06.763 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:06.759+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:07.194 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:07.191+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:07.777 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:07.774+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:08.241 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:08.238+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:08.783 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:08.781+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:09.214 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:09.211+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:09.751 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:09.749+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:10.232 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:10.229+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:10.761 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:10.758+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:11.239 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:11.236+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:11.781 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:11.778+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:12.262 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:12.259+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:12.803 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:12.801+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:13.311 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:13.309+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:13.759 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:13.756+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:14.312 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:14.309+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:14.767 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:14.765+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:15.294 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:15.292+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:15.812 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:15.810+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:16.304 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:16.302+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:16.799 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:16.797+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:17.326 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:17.324+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:17.753 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:17.751+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:18.365 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:18.363+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:18.730 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:18.727+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:19.365 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:19.363+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:19.712 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:19.709+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:20.378 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:20.376+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:20.734 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:20.732+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:21.411 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:21.409+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:21.772 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:21.769+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:22.413 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:22.411+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:22.760 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:22.758+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:23.370 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:23.367+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:23.807 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:23.805+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:24.416 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:24.358+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:24.840 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:24.838+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:25.338 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:25.335+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:25.869 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:25.867+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:26.335 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:26.332+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:26.901 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:26.899+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:27.357 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:27.355+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:27.925 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:27.923+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:28.312 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:28.309+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:28.965 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:28.962+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:29.356 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:29.354+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:29.973 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:29.970+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:30.353 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:30.350+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:30.928 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:30.926+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:31.366 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:31.364+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:31.904 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:31.901+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:32.366 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:32.363+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:32.900 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:32.897+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:33.378 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:33.376+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:33.914 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:33.911+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:34.421 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:34.419+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:34.898 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:34.896+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:35.435 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:35.433+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:35.935 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:35.933+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:36.430 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:36.428+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:36.935 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:36.933+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:37.460 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:37.458+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:37.985 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:37.982+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:38.476 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:38.473+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:38.949 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:38.947+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:39.481 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:39.478+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:39.937 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:39.935+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:40.508 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:40.506+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:40.974 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:40.971+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:41.494 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:41.491+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:42.007 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:42.004+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:42.487 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:42.484+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:42.985 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:42.981+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:43.499 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:43.496+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:44.001 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:43.997+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:44.460 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:44.457+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:44.990 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:44.986+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:45.422 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:45.417+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:46.011 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:46.007+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:46.449 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:46.444+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:46.988 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:46.984+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:47.415 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:47.411+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:48.036 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:48.032+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:48.436 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:48.433+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:48.996 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:48.992+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:49.390 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:49.387+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:50.016 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:50.013+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:50.419 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:50.416+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:51.060 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:51.056+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:51.390 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:51.388+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:52.084 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:52.082+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:52.420 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:52.418+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:53.060 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:53.058+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:53.375 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:53.372+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:54.065 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:54.062+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:54.375 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:54.373+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:55.023 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:55.021+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:55.336 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:55.334+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:56.070 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:56.067+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:56.386 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:56.383+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:57.044 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:57.042+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:57.391 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:57.389+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:58.051 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:58.049+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:58.397 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:58.395+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:27:59.071 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:27:59.069+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:27:59.398 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:27:59.396+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:00.082 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:00.079+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:00.378 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:00.376+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:01.060 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:01.058+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:01.376 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:01.374+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:02.021 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:02.018+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:02.338 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:02.335+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:03.026 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:03.024+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:03.317 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:03.315+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:04.064 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:04.061+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:04.323 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:04.321+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:05.081 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:05.078+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:05.332 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:05.329+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:06.102 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:06.100+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:06.309 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:06.307+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:07.142 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:07.140+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:07.354 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:07.351+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:08.109 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:08.107+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:08.388 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:08.385+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:09.080 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:09.077+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:09.365 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:09.362+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:10.055 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:10.052+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:10.412 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:10.410+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:11.006 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:11.004+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:11.430 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:11.428+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:12.008 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:12.006+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:12.424 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:12.422+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:12.964 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:12.962+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:13.429 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:13.427+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:13.954 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:13.952+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:14.414 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:14.412+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:14.994 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:14.992+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:15.436 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:15.434+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:16.010 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:16.008+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:16.446 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:16.444+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:16.995 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:16.993+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:17.458 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:17.456+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:18.001 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:17.999+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:18.445 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:18.443+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:19.045 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:19.043+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:19.485 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:19.482+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:20.081 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:20.079+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:20.444 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:20.442+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:21.109 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:21.107+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:21.467 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:21.465+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:22.086 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:22.084+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:22.442 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:22.439+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:23.122 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:23.119+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:23.452 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:23.450+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:24.118 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:24.116+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:24.458 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:24.456+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:25.127 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:25.123+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:25.462 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:25.459+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:26.133 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:26.130+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:26.437 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:26.434+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:27.109 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:27.106+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:27.392 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:27.389+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:28.080 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:28.077+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:28.377 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:28.374+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:29.032 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:29.029+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:29.402 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:29.398+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:30.068 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:30.065+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:30.423 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:30.419+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:31.054 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:31.051+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:31.387 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:31.383+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:32.092 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:32.089+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:32.431 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:32.428+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:33.089 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:33.085+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:33.411 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:33.407+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:34.122 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:34.120+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:34.459 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:34.457+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:35.170 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:35.167+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:35.475 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:35.472+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:36.212 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:36.209+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:36.459 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:36.456+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:37.240 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:37.237+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:37.456 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:37.454+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:38.260 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:38.258+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:38.425 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:38.423+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:39.268 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:39.265+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:39.419 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:39.416+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:40.243 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:40.241+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:40.450 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:40.448+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:41.196 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:41.194+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:41.499 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:41.497+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:42.150 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:42.148+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:42.523 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:42.520+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:43.145 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:43.143+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:43.549 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:43.547+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:44.124 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:44.122+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:44.528 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:44.526+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:45.101 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:45.099+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:45.486 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:45.484+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:46.061 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:46.059+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:46.439 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:46.436+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:47.068 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:47.065+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:47.395 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:47.392+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:48.068 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:48.065+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:48.347 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:48.344+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:49.034 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:49.032+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:49.325 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:49.323+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:50.027 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:50.024+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:50.315 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:50.313+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:50.990 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:50.987+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:51.309 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:51.306+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:51.948 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:51.945+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:52.272 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:52.269+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:52.906 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:52.904+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:53.283 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:53.281+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:53.904 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:53.901+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:54.278 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:54.275+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:54.881 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:54.879+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:55.254 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:55.251+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:55.841 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:55.839+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:56.211 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:56.208+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:56.860 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:56.857+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:57.236 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:57.234+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:57.899 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:57.897+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:58.257 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:58.254+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:58.913 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:58.911+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:28:59.233 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:28:59.231+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:28:59.877 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:28:59.874+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:00.248 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:00.245+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:00.926 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:00.923+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:01.269 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:01.267+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:01.905 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:01.902+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:02.293 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:02.291+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:02.940 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:02.937+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:03.299 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:03.297+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:03.918 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:03.915+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:04.336 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:04.333+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:04.922 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:04.919+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:05.344 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:05.342+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:05.908 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:05.905+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:06.393 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:06.391+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:06.936 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:06.934+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:07.427 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:07.425+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:07.917 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:07.914+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:08.457 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:08.453+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:08.924 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:08.921+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:09.425 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:09.421+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:09.971 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:09.968+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:10.449 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:10.445+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:11.021 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:11.018+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:11.426 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:11.423+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:12.032 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:12.029+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:12.471 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:12.468+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:13.019 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:13.016+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:13.467 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:13.464+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:14.019 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:14.016+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:14.517 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:14.513+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:15.002 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:14.999+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:15.531 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:15.528+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:16.027 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:16.024+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:16.540 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:16.537+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:17.025 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:17.022+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:17.542 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:17.540+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:18.022 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:18.019+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:18.590 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:18.588+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:19.051 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:19.048+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:19.626 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:19.624+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:20.077 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:20.075+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:20.585 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:20.583+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:21.096 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:21.094+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:21.561 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:21.559+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:22.067 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:22.065+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:22.555 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:22.552+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:23.046 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:23.044+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:23.580 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:23.577+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:24.069 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:24.066+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:24.555 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:24.553+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:25.100 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:25.097+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:25.510 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:25.508+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:26.072 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:26.070+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:26.462 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:26.460+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:27.100 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:27.098+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:27.449 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:27.447+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:28.096 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:28.094+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:28.490 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:28.487+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:29.072 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:29.070+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:29.511 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:29.509+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:30.082 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:30.079+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:30.553 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:30.550+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:31.109 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:31.107+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:31.582 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:31.580+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:32.125 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:32.123+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:32.554 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:32.552+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:33.154 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:33.152+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:33.548 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:33.546+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:34.177 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:34.174+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:34.506 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:34.503+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:35.175 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:35.172+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:35.514 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:35.512+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:36.146 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:36.144+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:36.547 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:36.544+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:37.145 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:37.142+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:37.536 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:37.533+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:38.106 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:38.104+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:38.536 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:38.534+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:39.107 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:39.104+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:39.566 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:39.563+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:40.084 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:40.082+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:40.600 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:40.598+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:41.041 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:41.038+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:41.646 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:41.643+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:42.005 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:42.002+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:42.690 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:42.687+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:43.018 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:43.015+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:43.669 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:43.666+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:44.020 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:44.018+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:44.698 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:44.696+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:45.061 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:45.059+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:45.683 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:45.681+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:46.110 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:46.107+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:46.668 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:46.666+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:47.076 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:47.074+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:47.702 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:47.699+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:48.084 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:48.081+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:48.728 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:48.726+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:49.038 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:49.036+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:49.716 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:49.714+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:50.030 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:50.028+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:50.749 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:50.745+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:51.047 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:51.043+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:51.737 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:51.733+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:52.071 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:52.068+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:52.752 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:52.749+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:53.067 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:53.063+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:53.798 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:53.795+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:54.018 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:54.015+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:54.787 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:54.783+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:54.992 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:54.989+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:55.822 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:55.818+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:56.032 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:56.029+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:56.836 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:56.833+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:57.065 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:57.061+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:57.822 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:57.818+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:58.066 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:58.062+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:58.779 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:58.776+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:29:59.063 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:29:59.060+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:29:59.820 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:29:59.817+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:00.108 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:00.106+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:00.845 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:00.842+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:01.077 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:01.074+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:01.894 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:01.892+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:02.033 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:02.031+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:02.909 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:02.906+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:03.060 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:03.058+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:03.874 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:03.871+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:04.018 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:04.016+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:04.914 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:04.911+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:05.042 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:05.040+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:05.924 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:05.922+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:06.041 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:06.039+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:06.911 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:06.909+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:07.083 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:07.080+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:07.944 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:07.942+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:08.049 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:08.047+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:08.969 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:08.966+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:09.095 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:09.093+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:09.970 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:09.967+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:10.083 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:10.081+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:10.949 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:10.947+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:11.075 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:11.073+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:11.979 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:11.976+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:12.047 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:12.045+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:12.935 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:12.932+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:13.047 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:13.044+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:13.887 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:13.885+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:14.016 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:14.014+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:14.839 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:14.837+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:14.986 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:14.983+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:15.880 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:15.877+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:16.006 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:16.004+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:16.841 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:16.838+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:16.961 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:16.958+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:17.878 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:17.875+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:17.979 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:17.977+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:18.831 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:18.829+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:18.989 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:18.987+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:19.836 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:19.834+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:19.994 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:19.991+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:20.821 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:20.819+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:20.986 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:20.984+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:21.845 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:21.843+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:21.972 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:21.969+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:22.828 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:22.826+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:22.964 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:22.962+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:23.802 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:23.799+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:23.968 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:23.965+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:24.852 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:24.849+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:24.922 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:24.919+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:25.865 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:25.863+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:25.947 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:25.945+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:26.861 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:26.859+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:26.949 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:26.947+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:27.897 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:27.895+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:27.951 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:27.949+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:28.926 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:28.923+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:28.991 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:28.989+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:29.920 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:29.918+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:29.951 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:29.949+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:30.915 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:30.913+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:30.985 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:30.983+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:31.930 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:31.928+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:31.999 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:31.996+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:32.955 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:32.953+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:32.971 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:32.969+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:33.988 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:33.985+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:33.991 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:33.988+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:34.985 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:34.982+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:35.039 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:35.036+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:36.018 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:36.015+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:36.072 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:36.068+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:37.040 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:37.037+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:37.052 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:37.049+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:37.999 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:37.996+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:38.035 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:38.032+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:39.011 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:39.007+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:39.083 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:39.079+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:40.030 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:40.027+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:40.075 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:40.072+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:41.063 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:41.059+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:41.081 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:41.078+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:42.067 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:42.063+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:42.084 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:42.081+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:43.045 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:43.042+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:43.102 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:43.100+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:44.088 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:44.086+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:44.090 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:44.088+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:45.052 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:45.050+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:45.090 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:45.087+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:46.039 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:46.037+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:46.055 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:46.053+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:47.014 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:47.012+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:47.095 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:47.093+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:48.010 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:48.008+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:48.088 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:48.085+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:49.050 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:49.048+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:49.098 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:49.095+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:50.018 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:50.015+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:50.116 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:50.114+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:50.990 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:50.987+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:51.121 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:51.119+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:51.988 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:51.985+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:52.120 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:52.117+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:53.027 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:53.024+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:53.094 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:53.091+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:54.045 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:54.042+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:54.096 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:54.093+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:55.048 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:55.046+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:55.059 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:55.057+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:56.070 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:56.068+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:56.096 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:56.093+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:57.056 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:57.053+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:57.115 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:57.112+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:58.015 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:58.013+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:58.138 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:58.135+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:59.005 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:59.002+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:30:59.184 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:30:59.182+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:30:59.975 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:30:59.973+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:00.213 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:00.211+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:00.990 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:00.988+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:01.236 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:01.233+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:02.026 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:02.024+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:02.200 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:02.197+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:03.047 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:03.044+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:03.247 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:03.245+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:04.040 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:04.038+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:04.240 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:04.237+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:05.002 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:05.000+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:05.198 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:05.196+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:06.049 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:06.047+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:06.209 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:06.207+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:07.067 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:07.065+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:07.173 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:07.170+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:08.103 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:08.100+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:08.170 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:08.168+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:09.116 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:09.114+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:09.200 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:09.198+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:10.117 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:10.115+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:10.248 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:10.245+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:11.120 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:11.118+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:11.272 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:11.269+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:12.167 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:12.164+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:12.316 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:12.314+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:13.206 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:13.203+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:13.330 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:13.328+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:14.170 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:14.168+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:14.325 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:14.322+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:15.137 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:15.134+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:15.281 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:15.278+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:16.123 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:16.119+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:16.302 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:16.298+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:17.162 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:17.159+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:17.308 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:17.305+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:18.158 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:18.155+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:18.268 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:18.265+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:19.131 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:19.127+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:19.303 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:19.300+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:20.138 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:20.135+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:20.254 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:20.251+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:21.104 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:21.101+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:21.293 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:21.289+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:22.099 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:22.096+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:22.295 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:22.292+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:23.137 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:23.134+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:23.285 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:23.281+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:24.186 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:24.182+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:24.325 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:24.323+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:25.235 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:25.233+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:25.309 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:25.307+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:26.283 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:26.281+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:26.316 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:26.313+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:27.272 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:27.269+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:27.334 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:27.332+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:28.264 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:28.262+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:28.363 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:28.361+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:29.269 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:29.267+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:29.408 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:29.406+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:30.277 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:30.274+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:30.436 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:30.434+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:31.266 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:31.264+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:31.430 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:31.428+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:32.296 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:32.293+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:32.401 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:32.398+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:33.342 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:33.339+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:33.416 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:33.414+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:34.363 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:34.361+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:34.377 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:34.375+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:35.322 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:35.320+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:35.352 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:35.349+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:36.295 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:36.292+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:36.382 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:36.379+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:37.255 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:37.252+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:37.389 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:37.386+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:38.272 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:38.270+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:38.392 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:38.389+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:39.298 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:39.296+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:39.371 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:39.369+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:40.337 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:40.335+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:40.369 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:40.366+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:41.294 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:41.291+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:41.358 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:41.356+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:42.338 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:42.336+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:42.345 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:42.343+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:43.337 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:43.335+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:43.383 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:43.381+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:44.371 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:44.369+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:44.414 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:44.412+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:45.372 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:45.370+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:45.408 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:45.406+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:46.375 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:46.373+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:46.394 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:46.391+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:47.356 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:47.354+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:47.394 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:47.391+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:48.372 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:48.369+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:48.382 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:48.380+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:49.340 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:49.337+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:49.364 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:49.362+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:50.353 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:50.351+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:50.393 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:50.390+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:51.313 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:51.310+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:51.411 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:51.409+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:52.312 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:52.309+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:52.442 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:52.440+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:53.271 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:53.269+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:53.436 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:53.433+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:54.280 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:54.278+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:54.415 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:54.413+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:55.271 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:55.268+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:55.411 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:55.409+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:56.318 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:56.316+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:56.364 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:56.361+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:57.328 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:57.326+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:57.340 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:57.338+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:58.305 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:58.303+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:58.368 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:58.366+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:31:59.283 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:31:59.279+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:31:59.331 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:31:59.328+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:00.257 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:00.254+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:00.341 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:00.338+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:01.260 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:01.256+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:01.342 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:01.338+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:02.296 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:02.292+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:02.317 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:02.314+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:03.279 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:03.275+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:03.334 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:03.331+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:04.314 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:04.310+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:04.348 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:04.344+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:05.353 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:05.349+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:05.356 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:05.352+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:06.339 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:06.336+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:06.398 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:06.395+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:07.332 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:07.329+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:07.395 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:07.391+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:08.338 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:08.335+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:08.346 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:08.344+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:09.358 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:09.356+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:09.390 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:09.388+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:10.345 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:10.342+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:10.382 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:10.379+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:11.297 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:11.295+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:11.421 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:11.419+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:12.296 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:12.294+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:12.428 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:12.425+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:13.285 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:13.283+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:13.403 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:13.400+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:14.277 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:14.274+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:14.383 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:14.381+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:15.316 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:15.314+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:15.376 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:15.374+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:16.275 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:16.272+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:16.377 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:16.375+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:17.261 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:17.259+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:17.361 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:17.359+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:18.231 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:18.228+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:18.390 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:18.388+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:19.241 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:19.238+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:19.350 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:19.348+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:20.284 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:20.282+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:20.317 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:20.315+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:21.283 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:21.280+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:21.361 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:21.358+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:22.255 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:22.253+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:22.360 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:22.358+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:23.266 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:23.263+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:23.338 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:23.335+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:24.295 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:24.293+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:24.368 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:24.365+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:25.277 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:25.275+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:25.395 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:25.392+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:26.249 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:26.247+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:26.408 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:26.406+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:27.258 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:27.254+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:27.401 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:27.399+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:28.243 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:28.230+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:28.427 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:28.425+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:29.225 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:29.223+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:29.389 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:29.386+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:30.269 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:30.266+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:30.372 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:30.370+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:31.253 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:31.250+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:31.375 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:31.373+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:32.238 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:32.236+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:32.339 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:32.337+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:33.254 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:33.252+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:33.345 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:33.343+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:34.260 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:34.257+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:34.365 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:34.363+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:35.242 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:35.240+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:35.338 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:35.336+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:36.251 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:36.249+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:36.319 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:36.317+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:37.271 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:37.268+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:37.300 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:37.297+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:38.253 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:38.250+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:38.298 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:38.295+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:39.214 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:39.212+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:39.286 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:39.284+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:40.184 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:40.182+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:40.292 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:40.290+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:41.223 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:41.221+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:41.281 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:41.278+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:42.225 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:42.222+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:42.269 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:42.266+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:43.212 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:43.208+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:43.317 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:43.314+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:44.253 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:44.249+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:44.366 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:44.363+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:45.240 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:45.236+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:45.340 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:45.337+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:46.206 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:46.202+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:46.329 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:46.326+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:47.248 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:47.245+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:47.363 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:47.360+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:48.224 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:48.221+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:48.331 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:48.328+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:49.237 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:49.234+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:49.360 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:49.357+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:50.279 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:50.276+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:50.355 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:50.351+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:51.265 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:51.263+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:51.400 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:51.397+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:52.295 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:52.293+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:52.447 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:52.445+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:53.246 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:53.244+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:53.441 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:53.438+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:54.283 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:54.280+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:54.396 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:54.393+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:55.285 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:55.282+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:55.370 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:55.367+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:56.288 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:56.285+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:56.349 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:56.346+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:57.337 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:57.335+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:57.390 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:57.388+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:58.322 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:58.319+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:58.407 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:58.405+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:32:59.348 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:32:59.346+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:32:59.379 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:32:59.376+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:00.338 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:00.335+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:00.353 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:00.351+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:01.329 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:01.327+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:01.383 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:01.381+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:02.353 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:02.351+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:02.369 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:02.367+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:03.317 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:03.315+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:03.340 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:03.338+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:04.305 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:04.303+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:04.359 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:04.356+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:05.350 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:05.347+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:05.351 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:05.349+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:06.369 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:06.367+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:06.388 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:06.385+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:07.341 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:07.339+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:07.400 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:07.397+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:08.327 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:08.325+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:08.398 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:08.395+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:09.371 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:09.369+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:09.442 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:09.440+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:10.406 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:10.403+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:10.426 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:10.423+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:11.411 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:11.409+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:11.430 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:11.427+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:12.389 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:12.387+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:12.437 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:12.435+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:13.365 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:13.362+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:13.468 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:13.466+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:14.382 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:14.380+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:14.440 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:14.437+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:15.347 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:15.345+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:15.466 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:15.463+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:16.334 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:16.331+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:16.467 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:16.465+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:17.371 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:17.369+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:17.511 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:17.508+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:18.356 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:18.353+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:18.490 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:18.487+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:19.399 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:19.396+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:19.499 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:19.497+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:20.413 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:20.410+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:20.465 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:20.463+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:21.376 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:21.374+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:21.508 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:21.505+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:22.393 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:22.391+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:22.505 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:22.503+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:23.418 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:23.416+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:23.527 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:23.525+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:24.391 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:24.389+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:24.502 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:24.499+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:25.362 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:25.359+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:25.454 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:25.450+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:26.381 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:26.378+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:26.457 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:26.453+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:27.373 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:27.370+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:27.501 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:27.498+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:28.338 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:28.334+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:28.496 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:28.493+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:29.382 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:29.378+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:29.496 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:29.492+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:30.343 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:30.340+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:30.510 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:30.506+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:31.394 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:31.391+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:31.517 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:31.514+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:32.425 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:32.421+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:32.493 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:32.489+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:33.425 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:33.422+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:33.518 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:33.516+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:34.425 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:34.423+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:34.518 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:34.516+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:35.424 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:35.422+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:35.494 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:35.492+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:36.464 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:36.462+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:36.467 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:36.465+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:37.431 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:37.428+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:37.502 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:37.500+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:38.419 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:38.417+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:38.517 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:38.515+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:39.374 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:39.372+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:39.501 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:39.499+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:40.330 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:40.328+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:40.489 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:40.487+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:41.349 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:41.346+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:41.534 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:41.532+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:42.329 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:42.327+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:42.578 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:42.574+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:43.379 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:43.377+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:43.562 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:43.560+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:44.412 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:44.409+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:44.539 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:44.537+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:45.375 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:45.373+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:45.584 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:45.582+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:46.389 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:46.386+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:46.536 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:46.533+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:47.360 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:47.358+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:47.505 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:47.503+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:48.317 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:48.315+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:48.459 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:48.456+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:49.340 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:49.337+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:49.487 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:49.484+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:50.300 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:50.297+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:50.438 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:50.436+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:51.289 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:51.286+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:51.466 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:51.463+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:52.257 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:52.255+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:52.468 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:52.465+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:53.304 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:53.301+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:53.443 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:53.440+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:54.341 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:54.338+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:54.397 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:54.394+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:55.298 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:55.295+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:55.351 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:55.349+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:56.281 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:56.278+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:56.320 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:56.318+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:57.320 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:57.318+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:57.338 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:57.335+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:58.291 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:58.288+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:33:58.301 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:58.299+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:59.263 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:33:59.261+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:33:59.287 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:33:59.284+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:00.214 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:00.212+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:00.275 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:00.272+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:01.178 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:01.176+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:01.320 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:01.318+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:02.163 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:02.160+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:02.336 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:02.333+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:03.134 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:03.132+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:03.381 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:03.378+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:04.176 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:04.174+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:04.404 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:04.402+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:05.201 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:05.199+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:05.417 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:05.415+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:06.202 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:06.199+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:06.398 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:06.396+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:07.238 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:07.236+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:07.400 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:07.397+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:08.208 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:08.205+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:08.420 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:08.417+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:09.235 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:09.232+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:09.410 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:09.407+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:10.271 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:10.268+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:10.400 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:10.397+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:11.234 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:11.230+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:11.357 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:11.354+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:12.245 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:12.242+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:12.395 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:12.391+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:13.292 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:13.289+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:13.350 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:13.347+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:14.254 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:14.250+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:14.321 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:14.317+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:15.250 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:15.247+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:15.276 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:15.273+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:16.230 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:16.227+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:16.292 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:16.289+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:17.262 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:17.260+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:17.335 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:17.333+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:18.262 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:18.259+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:18.382 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:18.380+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:19.279 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:19.277+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:19.418 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:19.415+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:20.271 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:20.269+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:20.430 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:20.428+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:21.289 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:21.287+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:21.402 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:21.399+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:22.322 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:22.319+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:22.372 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:22.370+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:23.296 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:23.293+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:23.409 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:23.407+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:24.259 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:24.256+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:24.443 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:24.441+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:25.271 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:25.268+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:25.472 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:25.470+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:26.243 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:26.240+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:26.458 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:26.453+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:27.210 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:27.208+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:27.474 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:27.471+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:28.240 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:28.237+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:28.508 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:28.505+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:29.209 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:29.207+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:29.552 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:29.550+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:30.230 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:30.228+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:30.547 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:30.545+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:31.274 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:31.272+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:31.586 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:31.584+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:32.289 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:32.286+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:32.556 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:32.554+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:33.288 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:33.286+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:33.577 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:33.575+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:34.242 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:34.239+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:34.602 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:34.600+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:35.247 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:35.245+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:35.616 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:35.614+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:36.265 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:36.263+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:36.661 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:36.658+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:37.280 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:37.277+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:37.613 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:37.610+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:38.310 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:38.308+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:38.609 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:38.607+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:39.325 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:39.323+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:39.582 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:39.580+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:40.332 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:40.330+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:40.614 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:40.612+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:41.363 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:41.360+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:41.583 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:41.580+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:42.334 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:42.331+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:42.583 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:42.581+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:43.362 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:43.360+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:43.581 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:43.579+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:44.373 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:44.371+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:44.624 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:44.621+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:45.391 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:45.389+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:45.627 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:45.624+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:46.350 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:46.348+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:46.651 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:46.648+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:47.356 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:47.354+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:47.674 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:47.672+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:48.398 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:48.395+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:48.661 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:48.659+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:49.412 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:49.410+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:49.686 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:49.683+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:50.433 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:50.430+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:50.646 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:50.642+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:51.470 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:51.467+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:51.695 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:51.692+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:52.478 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:52.475+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:52.699 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:52.695+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:53.451 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:53.448+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:53.666 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:53.663+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:54.473 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:54.470+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:54.707 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:54.703+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:55.519 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:55.516+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:55.690 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:55.685+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:56.563 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:56.560+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:56.674 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:56.670+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:57.522 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:57.519+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:57.627 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:57.624+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:58.473 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:58.470+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:58.633 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:58.630+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:34:59.517 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:34:59.514+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:34:59.637 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:34:59.633+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:00.477 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:00.474+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:00.660 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:00.658+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:01.519 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:01.517+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:01.629 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:01.627+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:02.486 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:02.484+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:02.628 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:02.625+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:03.483 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:03.480+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:03.601 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:03.598+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:04.452 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:04.450+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:04.620 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:04.617+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:05.494 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:05.492+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:05.667 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:05.665+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:06.485 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:06.483+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:06.638 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:06.636+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:07.522 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:07.520+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:07.596 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:07.594+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:08.508 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:08.505+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:08.557 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:08.554+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:09.518 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:09.515+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:09.582 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:09.579+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:10.532 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:10.530+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:10.624 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:10.621+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:11.542 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:11.540+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:11.634 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:11.631+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:12.532 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:12.530+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:12.640 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:12.638+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:13.514 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:13.512+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:13.669 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:13.667+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:14.520 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:14.518+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:14.691 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:14.689+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:15.565 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:15.563+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:15.670 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:15.667+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:16.564 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:16.562+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:16.627 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:16.625+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:17.602 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:17.599+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:17.670 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:17.668+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:18.648 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:18.646+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:18.694 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:18.692+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:19.615 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:19.612+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:19.679 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:19.677+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:20.631 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:20.629+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:20.710 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:20.708+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:21.675 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:21.672+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:21.713 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:21.710+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:22.669 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:22.667+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:22.696 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:22.694+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:23.689 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:23.686+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:23.698 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:23.696+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:24.696 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:24.693+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:24.702 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:24.700+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:25.709 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:25.706+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:25.715 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:25.713+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:26.692 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:26.689+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:26.697 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:26.695+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:27.660 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:27.658+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:27.694 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:27.691+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:28.649 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:28.646+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:28.712 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:28.710+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:29.658 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:29.656+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:29.730 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:29.728+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:30.679 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:30.676+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:30.710 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:30.707+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:31.662 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:31.660+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:31.747 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:31.745+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:32.658 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:32.656+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:32.698 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:32.696+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:33.630 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:33.628+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:33.683 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:33.681+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:34.628 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:34.625+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:34.705 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:34.702+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:35.608 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:35.604+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:35.716 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:35.713+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:36.651 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:36.647+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:36.723 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:36.720+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:37.682 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:37.678+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:37.692 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:37.688+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:38.675 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:38.671+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:38.720 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:38.717+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:39.720 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:39.716+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:39.734 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:39.730+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:40.695 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:40.691+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:40.725 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:40.721+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:41.682 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:41.679+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:41.750 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:41.746+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:42.692 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:42.689+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:42.772 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:42.769+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:43.680 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:43.677+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:43.755 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:43.753+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:44.710 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:44.708+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:44.737 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:44.735+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:45.707 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:45.705+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:45.782 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:45.780+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:46.721 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:46.719+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:46.817 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:46.815+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:47.699 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:47.697+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:47.834 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:47.832+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:48.748 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:48.745+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:48.862 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:48.860+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:49.706 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:49.704+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:49.863 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:49.861+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:50.754 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:50.752+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:50.819 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:50.816+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:51.790 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:51.788+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:51.859 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:51.857+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:52.813 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:52.811+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:52.840 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:52.838+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:53.832 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:53.830+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:53.848 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:53.846+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:54.837 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:54.834+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:54.868 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:54.866+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:55.833 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:55.831+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:55.850 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:55.848+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:56.792 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:56.790+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:56.891 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:56.889+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:57.813 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:57.811+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:57.934 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:57.932+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:58.771 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:58.769+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:58.947 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:58.944+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:35:59.808 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:35:59.805+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:35:59.922 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:35:59.920+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:00.842 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:00.840+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:00.932 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:00.930+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:01.893 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:01.890+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:01.976 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:01.974+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:02.856 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:02.853+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:02.994 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:02.992+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:03.855 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:03.853+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:04.021 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:04.018+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:04.832 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:04.830+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:05.066 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:05.064+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:05.833 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:05.831+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:06.106 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:06.104+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:06.849 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:06.847+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:07.068 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:07.066+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:07.853 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:07.851+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:08.098 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:08.096+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:08.867 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:08.865+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:09.059 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:09.057+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:09.819 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:09.817+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:10.062 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:10.060+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:10.774 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:10.771+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:11.032 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:11.030+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:11.783 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:11.781+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:12.019 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:12.017+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:12.746 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:12.744+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:12.986 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:12.984+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:13.745 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:13.742+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:13.951 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:13.949+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:14.790 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:14.788+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:14.986 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:14.984+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:15.806 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:15.804+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:16.011 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:16.009+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:16.769 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:16.767+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:17.029 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:17.026+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:17.798 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:17.795+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:18.016 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:18.012+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:18.753 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:18.749+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:19.040 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:19.036+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:19.778 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:19.774+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:19.994 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:19.991+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:20.773 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:20.770+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:20.984 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:20.981+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:21.816 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:21.813+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:22.026 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:22.022+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:22.838 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:22.835+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:23.010 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:23.007+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:23.815 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:23.812+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:23.975 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:23.972+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:24.841 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:24.838+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:24.932 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:24.928+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:25.799 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:25.796+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:25.975 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:25.972+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:26.832 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:26.830+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:26.929 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:26.926+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:27.850 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:27.848+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:27.910 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:27.908+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:28.900 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:28.897+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:28.960 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:28.957+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:29.892 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:29.889+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:30.008 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:30.006+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:30.857 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:30.855+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:30.968 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:30.965+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:31.889 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:31.887+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:32.014 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:32.011+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:32.857 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:32.854+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:33.004 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:33.001+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:33.850 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:33.848+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:33.966 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:33.964+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:34.887 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:34.885+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:34.962 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:34.960+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:35.853 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:35.851+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:35.957 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:35.955+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:36.878 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:36.876+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:36.964 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:36.961+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:37.879 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:37.877+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:37.976 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:37.974+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:38.869 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:38.867+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:38.953 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:38.951+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:39.859 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:39.857+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:40.005 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:40.001+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:40.869 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:40.866+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:41.025 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:41.021+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:41.866 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:41.864+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:41.983 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:41.981+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:42.889 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:42.886+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:42.971 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:42.969+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:43.887 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:43.884+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:43.993 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:43.991+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:44.925 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:44.923+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:45.019 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:45.016+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:45.926 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:45.924+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:45.980 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:45.977+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:46.892 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:46.890+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:46.972 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:46.970+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:47.866 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:47.863+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:47.983 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:47.981+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:48.869 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:48.867+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:49.026 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:49.024+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:49.913 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:49.911+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:49.989 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:49.986+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:50.911 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:50.909+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:51.039 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:51.037+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:51.920 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:51.918+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:52.016 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:52.014+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:52.931 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:52.929+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:53.011 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:53.009+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:53.892 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:53.890+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:54.044 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:54.042+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:54.937 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:54.935+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:55.036 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:55.034+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:55.979 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:55.976+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:56.070 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:56.068+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:57.002 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:57.000+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:57.096 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:57.094+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:57.986 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:57.984+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:58.082 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:58.069+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:36:59.023 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:36:59.020+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:36:59.114 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:36:59.111+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:00.022 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:00.019+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:00.162 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:00.159+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:01.010 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:01.007+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:01.136 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:01.132+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:02.047 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:02.043+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:02.158 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:02.155+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:03.000 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:02.997+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:03.166 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:03.163+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:04.004 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:04.000+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:04.189 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:04.186+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:04.964 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:04.961+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:05.154 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:05.150+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:05.931 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:05.928+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:06.155 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:06.152+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:06.949 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:06.946+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:07.152 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:07.149+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:07.941 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:07.938+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:08.177 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:08.174+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:08.908 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:08.905+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:09.160 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:09.157+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:09.871 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:09.869+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:10.142 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:10.140+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:10.851 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:10.849+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:11.192 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:11.190+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:11.822 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:11.820+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:12.198 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:12.196+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:12.774 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:12.772+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:13.236 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:13.234+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:13.760 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:13.758+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:14.239 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:14.237+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:14.768 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:14.766+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:15.214 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:15.212+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:15.751 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:15.748+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:16.175 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:16.173+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:16.765 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:16.763+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:17.201 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:17.199+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:17.731 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:17.729+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:18.218 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:18.216+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:18.778 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:18.776+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:19.269 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:19.267+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:19.792 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:19.789+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:20.262 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:20.259+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:20.811 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:20.809+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:21.231 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:21.229+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:21.783 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:21.780+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:22.251 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:22.248+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:22.799 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:22.797+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:23.245 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:23.242+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:23.755 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:23.753+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:24.218 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:24.215+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:24.721 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:24.719+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:25.172 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:25.170+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:25.765 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:25.762+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:26.192 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:26.189+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:26.755 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:26.753+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:27.165 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:27.163+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:27.720 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:27.717+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:28.208 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:28.206+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:28.765 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:28.761+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:29.231 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:29.228+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:29.790 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:29.788+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:30.194 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:30.191+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:30.786 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:30.783+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:31.198 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:31.196+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:31.766 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:31.764+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:32.230 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:32.228+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:32.789 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:32.787+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:33.274 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:33.271+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:33.744 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:33.741+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:34.287 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:34.285+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:34.706 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:34.703+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:35.258 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:35.256+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:35.661 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:35.658+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:36.272 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:36.270+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:36.678 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:36.676+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:37.244 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:37.242+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:37.646 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:37.643+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:38.267 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:38.264+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:38.685 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:38.683+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:39.310 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:39.308+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:39.660 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:39.658+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:40.305 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:40.302+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:40.644 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:40.642+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:41.351 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:41.349+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:41.604 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:41.602+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:42.365 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:42.362+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:42.575 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:42.573+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:43.362 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:43.360+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:43.532 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:43.528+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:44.406 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:44.403+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:44.546 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:44.543+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:45.362 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:45.359+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:45.596 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:45.592+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:46.390 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:46.387+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:46.594 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:46.590+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:47.346 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:47.343+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:47.597 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:47.594+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:48.368 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:48.364+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:48.566 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:48.563+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:49.368 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:49.364+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:49.533 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:49.529+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:50.355 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:50.352+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:50.499 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:50.496+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:51.326 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:51.323+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:51.470 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:51.467+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:52.370 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:52.367+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:52.429 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:52.426+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:53.390 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:53.387+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:53.403 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:53.400+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:54.366 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:54.362+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:54.401 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:54.399+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:55.380 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:55.378+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:55.385 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:55.383+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:56.350 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:56.348+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:56.416 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:56.414+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:57.337 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:57.334+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:57.433 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:57.430+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:58.312 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:58.309+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:58.449 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:58.446+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:37:59.281 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:37:59.279+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:37:59.427 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:37:59.425+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:00.248 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:00.245+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:00.434 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:00.432+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:01.289 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:01.287+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:01.403 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:01.400+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:02.259 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:02.257+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:02.419 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:02.416+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:03.228 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:03.226+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:03.398 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:03.395+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:04.223 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:04.220+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:04.437 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:04.435+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:05.225 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:05.223+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:05.399 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:05.397+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:06.269 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:06.266+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:06.446 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:06.444+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:07.241 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:07.238+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:07.483 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:07.481+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:08.197 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:08.195+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:08.485 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:08.483+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:09.168 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:09.165+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:09.522 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:09.520+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:10.135 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:10.132+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:10.538 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:10.536+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:11.095 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:11.093+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:11.542 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:11.538+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:12.115 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:12.113+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:12.525 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:12.522+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:13.146 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:13.143+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:13.561 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:13.559+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:14.156 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:14.153+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:14.542 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:14.540+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:15.154 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:15.152+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:15.525 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:15.523+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:16.143 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:16.141+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:16.568 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:16.566+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:17.168 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:17.165+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:17.596 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:17.594+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:18.181 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:18.179+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:18.599 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:18.597+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:19.200 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:19.197+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:19.593 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:19.591+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:20.226 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:20.224+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:20.591 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:20.588+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:21.250 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:21.248+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:21.549 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:21.547+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:22.248 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:22.246+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:22.596 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:22.594+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:23.231 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:23.229+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:23.643 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:23.641+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:24.254 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:24.252+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:24.636 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:24.634+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:25.272 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:25.270+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:25.664 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:25.662+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:26.294 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:26.292+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:26.616 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:26.612+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:27.338 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:27.335+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:27.614 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:27.610+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:28.348 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:28.345+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:28.586 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:28.583+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:29.386 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:29.383+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:29.608 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:29.604+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:30.420 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:30.417+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:30.588 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:30.585+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:31.377 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:31.374+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:31.562 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:31.559+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:32.375 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:32.370+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:32.538 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:32.535+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:33.370 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:33.367+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:33.536 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:33.532+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:34.337 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:34.334+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:34.503 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:34.500+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:35.368 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:35.365+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:35.462 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:35.459+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:36.368 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:36.366+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:36.416 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:36.414+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:37.322 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:37.320+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:37.453 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:37.450+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:38.321 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:38.319+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:38.470 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:38.468+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:39.369 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:39.367+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:39.439 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:39.436+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:40.322 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:40.320+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:40.412 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:40.409+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:41.294 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:41.292+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:41.447 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:41.445+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:42.323 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:42.321+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:42.419 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:42.417+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:43.365 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:43.362+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:43.396 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:43.394+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:44.336 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:44.334+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:44.436 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:44.433+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:45.347 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:45.344+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:45.478 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:45.476+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:46.315 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:46.312+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:46.461 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:46.459+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:47.275 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:47.273+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:47.446 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:47.441+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:48.312 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:48.310+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:48.411 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:48.409+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:49.287 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:49.284+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:49.424 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:49.422+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:50.324 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:50.322+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:50.376 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:50.374+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:51.282 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:51.280+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:51.348 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:51.346+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:52.332 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:52.329+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:52.362 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:52.360+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:53.325 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:53.323+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:53.369 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:53.366+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:54.305 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:54.303+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:54.391 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:54.388+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:55.316 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:55.314+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:55.359 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:55.357+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:56.299 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:56.297+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:56.323 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:56.321+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:57.298 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:57.295+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:57.363 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:57.361+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:58.321 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:58.319+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:38:58.344 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:58.340+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:59.307 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:38:59.305+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:38:59.350 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:38:59.348+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:00.286 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:00.284+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:00.363 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:00.361+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:01.291 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:01.289+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:01.336 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:01.334+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:02.337 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:02.335+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:02.382 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:02.379+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:03.300 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:03.298+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:03.386 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:03.384+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:04.346 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:04.344+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:04.433 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:04.431+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:05.363 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:05.360+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:05.453 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:05.451+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:06.361 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:06.359+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:06.463 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:06.461+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:07.397 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:07.395+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:07.440 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:07.438+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:08.376 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:08.374+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:08.407 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:08.405+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:09.359 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:09.356+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:09.361 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:09.358+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:10.341 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:10.337+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:10.356 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:10.352+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:11.332 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:11.329+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:11.364 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:11.361+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:12.287 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:12.284+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:12.338 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:12.335+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:13.330 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:13.327+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:13.369 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:13.365+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:14.304 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:14.300+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:14.387 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:14.383+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:15.265 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:15.262+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:15.386 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:15.383+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:16.296 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:16.293+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:16.426 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:16.422+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:17.310 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:17.307+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:17.451 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:17.448+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:18.323 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:18.321+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:18.479 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:18.477+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:19.352 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:19.350+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:19.440 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:19.437+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:20.375 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:20.373+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:20.480 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:20.478+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:21.375 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:21.373+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:21.505 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:21.503+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:22.383 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:22.381+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:22.520 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:22.518+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:23.349 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:23.347+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:23.557 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:23.555+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:24.322 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:24.318+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:24.541 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:24.539+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:25.347 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:25.345+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:25.553 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:25.551+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:26.368 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:26.366+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:26.547 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:26.545+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:27.417 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:27.415+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:27.579 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:27.577+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:28.450 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:28.447+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:28.553 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:28.550+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:29.405 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:29.402+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:29.538 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:29.536+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:30.425 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:30.423+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:30.498 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:30.496+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:31.437 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:31.435+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:31.462 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:31.460+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:32.392 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:32.389+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:32.486 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:32.483+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:33.386 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:33.383+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:33.464 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:33.461+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:34.363 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:34.360+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:34.435 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:34.433+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:35.381 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:35.378+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:35.431 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:35.429+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:36.404 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:36.401+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:36.476 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:36.474+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:37.447 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:37.444+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:37.489 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:37.487+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:38.405 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:38.403+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:38.492 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:38.490+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:39.365 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:39.363+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:39.541 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:39.539+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:40.322 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:40.320+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:40.560 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:40.558+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:41.315 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:41.313+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:41.529 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:41.527+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:42.345 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:42.343+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:42.508 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:42.506+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:43.323 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:43.321+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:43.463 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:43.461+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:44.316 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:44.314+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:44.455 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:44.453+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:45.362 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:45.360+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:45.492 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:45.490+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:46.385 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:46.382+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:46.530 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:46.528+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:47.415 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:47.413+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:47.521 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:47.519+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:48.367 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:48.364+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:48.519 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:48.517+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:49.330 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:49.328+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:49.559 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:49.557+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:50.351 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:50.349+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:50.529 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:50.527+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:51.342 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:51.339+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:51.503 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:51.501+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:52.331 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:52.328+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:52.499 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:52.495+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:53.351 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:53.347+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:53.483 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:53.480+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:54.379 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:54.376+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:54.441 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:54.438+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:55.414 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:55.411+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:55.458 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:55.455+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:56.385 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:56.382+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:56.476 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:56.473+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:57.425 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:57.422+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:57.485 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:57.482+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:58.432 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:58.429+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:58.521 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:58.518+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:39:59.477 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:39:59.474+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:39:59.523 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:39:59.520+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:00.506 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:00.503+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:00.522 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:00.519+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:01.516 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:01.513+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:01.548 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:01.546+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:02.518 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:02.516+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:02.547 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:02.545+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:03.518 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:03.516+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:03.541 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:03.539+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:04.498 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:04.495+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:04.558 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:04.556+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:05.495 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:05.493+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:05.596 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:05.594+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:06.459 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:06.456+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:06.567 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:06.565+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:07.493 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:07.491+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:07.536 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:07.533+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:08.472 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:08.470+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:08.492 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:08.490+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:09.446 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:09.444+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:09.463 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:09.461+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:10.484 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:10.481+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:10.489 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:10.487+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:11.445 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:11.443+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:11.449 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:11.447+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:12.458 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:12.456+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:12.485 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:12.483+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:13.415 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:13.413+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:13.442 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:13.440+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:14.369 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:14.367+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:14.450 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:14.448+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:15.346 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:15.343+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:15.433 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:15.431+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:16.332 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:16.329+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:16.388 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:16.385+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:17.287 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:17.285+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:17.397 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:17.395+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:18.312 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:18.310+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:18.363 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:18.360+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:19.290 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:19.288+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:19.325 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:19.323+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:20.314 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:20.312+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:20.320 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:20.318+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:21.326 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:21.323+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:21.352 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:21.350+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:22.358 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:22.356+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:22.392 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:22.390+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:23.331 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:23.329+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:23.411 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:23.409+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:24.377 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:24.374+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:24.412 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:24.410+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:25.391 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:25.389+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:25.410 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:25.408+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:26.358 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:26.356+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:26.453 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:26.451+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:27.375 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:27.373+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:27.486 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:27.484+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:28.329 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:28.327+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:28.458 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:28.456+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:29.326 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:29.324+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:29.508 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:29.505+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:30.353 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:30.351+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:30.488 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:30.486+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:31.324 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:31.322+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:31.462 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:31.460+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:32.371 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:32.369+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:32.465 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:32.463+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:33.412 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:33.410+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:33.499 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:33.497+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:34.443 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:34.441+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:34.468 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:34.466+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:35.425 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:35.422+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:35.512 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:35.509+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:36.418 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:36.414+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:36.550 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:36.547+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:37.461 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:37.458+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:37.536 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:37.532+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:38.505 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:38.502+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:38.544 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:38.541+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:39.488 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:39.485+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:39.553 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:39.549+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:40.477 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:40.473+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:40.520 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:40.517+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:41.466 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:41.462+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:41.562 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:41.559+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:42.452 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:42.449+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:42.537 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:42.534+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:43.454 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:43.451+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:43.518 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:43.515+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:44.454 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:44.451+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:44.560 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:44.557+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:45.470 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:45.468+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:45.567 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:45.565+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:46.441 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:46.439+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:46.556 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:46.554+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:47.459 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:47.457+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:47.527 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:47.525+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:48.509 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:48.507+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:48.544 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:48.542+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:49.518 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:49.515+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:49.584 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:49.582+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:50.482 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:50.480+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:50.561 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:50.559+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:51.435 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:51.433+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:51.577 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:51.575+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:52.424 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:52.422+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:52.584 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:52.581+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:53.471 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:53.469+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:53.599 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:53.597+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:54.462 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:54.460+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:54.579 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:54.577+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:55.424 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:55.422+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:55.627 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:55.625+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:56.453 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:56.448+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:56.613 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:56.611+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:57.441 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:57.439+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:57.658 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:57.656+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:58.415 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:58.413+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:58.686 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:58.683+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:40:59.398 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:40:59.396+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:40:59.645 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:40:59.643+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:00.416 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:00.414+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:00.617 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:00.615+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:01.413 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:01.411+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:01.598 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:01.595+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:02.368 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:02.366+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:02.630 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:02.628+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:03.393 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:03.390+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:03.676 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:03.674+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:04.431 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:04.429+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:04.631 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:04.629+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:05.440 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:05.438+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:05.643 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:05.640+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:06.474 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:06.472+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:06.596 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:06.594+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:07.508 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:07.506+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:07.563 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:07.560+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:08.497 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:08.495+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:08.593 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:08.590+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:09.504 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:09.502+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:09.592 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:09.590+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:10.513 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:10.511+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:10.571 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:10.569+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:11.544 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:11.541+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:11.569 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:11.567+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:12.590 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:12.588+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:12.595 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:12.593+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:13.565 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:13.563+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:13.613 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:13.611+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:14.554 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:14.552+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:14.607 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:14.605+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:15.580 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:15.578+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:15.586 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:15.584+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:16.579 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:16.576+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:16.601 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:16.599+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:17.532 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:17.529+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:17.650 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:17.646+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:18.500 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:18.496+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:18.625 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:18.621+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:19.513 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:19.509+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:19.669 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:19.666+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:20.487 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:20.484+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:20.691 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:20.688+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:21.528 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:21.524+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:21.706 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:21.703+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:22.491 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:22.487+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:22.707 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:22.703+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:23.533 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:23.530+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:23.709 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:23.706+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:24.563 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:24.560+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:24.752 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:24.749+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:25.539 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:25.536+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:25.747 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:25.744+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:26.570 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:26.567+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:26.766 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:26.763+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:27.553 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:27.551+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:27.817 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:27.815+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:28.509 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:28.507+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:28.843 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:28.841+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:29.465 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:29.463+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:29.854 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:29.851+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:30.501 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:30.499+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:30.857 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:30.854+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:31.536 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:31.534+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:31.895 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:31.893+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:32.494 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:32.492+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:32.925 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:32.923+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:33.522 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:33.520+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:33.915 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:33.913+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:34.557 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:34.555+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:34.900 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:34.897+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:35.598 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:35.596+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:35.861 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:35.859+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:36.590 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:36.588+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:36.841 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:36.839+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:37.606 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:37.604+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:37.805 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:37.803+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:38.635 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:38.632+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:38.831 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:38.829+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:39.641 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:39.639+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:39.849 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:39.847+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:40.677 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:40.675+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:40.811 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:40.809+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:41.641 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:41.639+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:41.779 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:41.776+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:42.610 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:42.607+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:42.749 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:42.747+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:43.577 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:43.575+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:43.709 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:43.707+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:44.537 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:44.534+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:44.687 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:44.685+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:45.550 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:45.548+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:45.689 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:45.687+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:46.568 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:46.566+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:46.690 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:46.688+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:47.607 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:47.605+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:47.680 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:47.677+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:48.629 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:48.627+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:48.649 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:48.647+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:49.622 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:49.620+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:49.677 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:49.675+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:50.642 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:50.640+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:50.660 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:50.658+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:51.596 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:51.594+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:51.622 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:51.620+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:52.588 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:52.585+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:52.661 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:52.659+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:53.573 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:53.571+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:53.656 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:53.654+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:54.613 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:54.611+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:54.692 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:54.690+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:55.580 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:55.578+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:55.713 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:55.710+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:56.582 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:56.579+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:56.735 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:56.733+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:57.551 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:57.549+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:57.723 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:57.721+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:58.506 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:58.503+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:58.742 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:58.740+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:41:59.459 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:41:59.457+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:41:59.693 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:41:59.691+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:00.481 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:00.478+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:00.673 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:00.670+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:01.505 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:01.502+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:01.685 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:01.681+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:02.528 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:02.525+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:02.721 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:02.718+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:03.499 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:03.496+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:03.681 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:03.678+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:04.482 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:04.479+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:04.635 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:04.631+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:05.515 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:05.512+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:05.615 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:05.611+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:06.513 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:06.510+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:06.612 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:06.609+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:07.518 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:07.515+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:07.608 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:07.605+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:08.517 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:08.513+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:08.626 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:08.623+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:09.564 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:09.561+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:09.606 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:09.604+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:10.541 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:10.539+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:10.598 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:10.596+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:11.496 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:11.494+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:11.632 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:11.630+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:12.527 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:12.524+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:12.604 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:12.602+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:13.564 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:13.562+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:13.598 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:13.596+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:14.562 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:14.560+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:14.562 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:14.560+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:15.552 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:15.550+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:15.573 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:15.571+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:16.581 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:16.579+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:16.592 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:16.589+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:17.595 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:17.593+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:17.628 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:17.626+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:18.567 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:18.565+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:18.583 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:18.581+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:19.568 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:19.566+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:19.604 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:19.601+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:20.531 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:20.528+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:20.635 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:20.633+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:21.523 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:21.521+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:21.652 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:21.649+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:22.554 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:22.552+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:22.689 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:22.687+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:23.523 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:23.521+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:23.650 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:23.648+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:24.552 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:24.549+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:24.700 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:24.698+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:25.554 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:25.552+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:25.654 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:25.652+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:26.601 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:26.598+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:26.705 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:26.702+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:27.651 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:27.649+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:27.680 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:27.678+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:28.654 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:28.652+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:28.730 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:28.728+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:29.636 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:29.633+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:29.721 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:29.718+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:30.677 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:30.675+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:30.683 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:30.681+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:31.648 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:31.646+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:31.662 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:31.660+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:32.601 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:32.598+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:32.616 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:32.614+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:33.604 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:33.601+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:33.624 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:33.622+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:34.586 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:34.584+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:34.618 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:34.616+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:35.560 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:35.558+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:35.626 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:35.624+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:36.550 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:36.548+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:36.676 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:36.674+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:37.516 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:37.513+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:37.719 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:37.717+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:38.541 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:38.538+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:38.686 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:38.684+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:39.492 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:39.490+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:39.706 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:39.704+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:40.457 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:40.455+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:40.714 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:40.712+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:41.452 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:41.450+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:41.732 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:41.729+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:42.497 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:42.494+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:42.718 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:42.716+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:43.489 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:43.486+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:43.699 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:43.695+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:44.483 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:44.479+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:44.702 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:44.699+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:45.493 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:45.489+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:45.664 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:45.660+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:46.513 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:46.510+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:46.691 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:46.688+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:47.524 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:47.521+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:47.663 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:47.660+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:48.566 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:48.563+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:48.638 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:48.634+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:49.571 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:49.567+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:49.610 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:49.606+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:50.589 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:50.584+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:50.643 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:50.640+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:51.575 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:51.572+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:51.681 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:51.678+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:52.594 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:52.592+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:52.638 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:52.636+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:53.589 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:53.587+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:53.642 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:53.640+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:54.596 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:54.594+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:54.608 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:54.602+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:55.627 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:55.625+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:55.631 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:55.628+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:56.621 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:56.619+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:56.665 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:56.663+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:57.576 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:57.574+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:57.672 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:57.670+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:58.591 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:58.589+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:58.633 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:58.631+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:42:59.602 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:42:59.599+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:42:59.640 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:42:59.637+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:00.643 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:00.641+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:00.644 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:00.641+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:01.601 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:01.599+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:01.660 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:01.658+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:02.590 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:02.587+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:02.622 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:02.620+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:03.558 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:03.555+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:03.617 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:03.615+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:04.531 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:04.529+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:04.601 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:04.599+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:05.547 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:05.545+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:05.629 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:05.626+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:06.582 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:06.580+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:06.609 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:06.607+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:07.593 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:07.591+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:07.625 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:07.623+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:08.599 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:08.596+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:08.608 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:08.606+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:09.569 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:09.567+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:09.600 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:09.598+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:10.607 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:10.605+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:10.639 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:10.637+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:11.599 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:11.597+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:11.655 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:11.653+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:12.568 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:12.566+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:12.648 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:12.645+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:13.595 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:13.593+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:13.605 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:13.603+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:14.572 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:14.569+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:14.601 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:14.598+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:15.553 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:15.550+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:15.602 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:15.600+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:16.534 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:16.532+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:16.605 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:16.603+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:17.519 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:17.517+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:17.625 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:17.623+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:18.470 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:18.467+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:18.676 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:18.674+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:19.485 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:19.483+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:19.704 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:19.702+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:20.523 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:20.521+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:20.741 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:20.739+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:21.504 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:21.502+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:21.768 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:21.766+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:22.493 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:22.490+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:22.816 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:22.813+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:23.467 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:23.464+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:23.855 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:23.853+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:24.495 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:24.493+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:24.853 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:24.851+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:25.473 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:25.471+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:25.881 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:25.878+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:26.497 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:26.494+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:26.853 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:26.850+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:27.540 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:27.536+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:27.818 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:27.815+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:28.590 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:28.586+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:28.830 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:28.827+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:29.573 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:29.570+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:29.802 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:29.799+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:30.570 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:30.566+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:30.823 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:30.820+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:31.548 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:31.544+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:31.841 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:31.837+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:32.554 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:32.551+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:32.803 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:32.800+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:33.601 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:33.598+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:33.854 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:33.851+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:34.553 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:34.550+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:34.869 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:34.867+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:35.550 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:35.548+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:35.825 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:35.823+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:36.569 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:36.567+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:36.859 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:36.857+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:37.591 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:37.588+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:37.846 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:37.844+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:38.545 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:38.543+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:38.854 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:38.852+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:39.545 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:39.543+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:39.853 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:39.851+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:40.502 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:40.499+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:40.852 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:40.849+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:41.469 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:41.466+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:41.891 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:41.889+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:42.421 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:42.419+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:42.891 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:42.889+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:43.391 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:43.389+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:43.873 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:43.871+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:44.366 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:44.363+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:44.863 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:44.861+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:45.389 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:45.387+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:45.851 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:45.849+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:46.423 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:46.421+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:46.877 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:46.875+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:47.393 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:47.390+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:47.894 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:47.892+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:48.348 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:48.345+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:48.887 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:48.884+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:49.355 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:49.353+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:49.867 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:49.865+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:50.375 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:50.373+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:50.825 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:50.822+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:51.417 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:51.414+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:51.840 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:51.837+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:52.400 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:52.397+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:52.889 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:52.887+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:53.397 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:53.395+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:53.933 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:53.931+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:54.389 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:54.386+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:54.916 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:54.914+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:55.414 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:55.412+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:55.949 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:55.947+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:56.379 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:56.376+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:56.965 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:56.963+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:57.370 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:57.368+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:57.970 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:57.968+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:58.330 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:58.328+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:58.976 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:58.973+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:43:59.292 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:43:59.290+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:43:59.991 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:43:59.989+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:00.319 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:00.316+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:00.963 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:00.961+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:01.271 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:01.268+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:01.991 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:01.989+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:02.319 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:02.317+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:03.035 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:03.033+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:03.367 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:03.365+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:04.042 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:04.039+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:04.378 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:04.376+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:05.009 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:05.007+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:05.336 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:05.334+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:05.962 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:05.960+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:06.310 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:06.308+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:06.997 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:06.995+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:07.301 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:07.298+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:07.983 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:07.981+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:08.254 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:08.252+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:08.994 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:08.991+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:09.221 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:09.218+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:09.972 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:09.968+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:10.267 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:10.264+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:10.965 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:10.961+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:11.247 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:11.244+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:11.973 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:11.969+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:12.253 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:12.249+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:12.969 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:12.966+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:13.245 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:13.242+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:13.941 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:13.938+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:14.257 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:14.254+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:14.899 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:14.895+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:15.264 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:15.260+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:15.867 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:15.864+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:16.232 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:16.229+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:16.841 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:16.838+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:17.216 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:17.213+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:17.801 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:17.799+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:18.207 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:18.205+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:18.773 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:18.771+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:19.207 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:19.205+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:19.806 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:19.804+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:20.162 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:20.160+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:20.839 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:20.837+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:21.117 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:21.115+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:21.861 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:21.858+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:22.133 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:22.131+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:22.865 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:22.863+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:23.137 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:23.135+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:23.853 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:23.851+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:24.140 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:24.138+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:24.880 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:24.878+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:25.127 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:25.125+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:25.855 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:25.853+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:26.123 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:26.121+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:26.886 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:26.884+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:27.080 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:27.078+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:27.845 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:27.843+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:28.120 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:28.118+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:28.885 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:28.882+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:29.073 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:29.071+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:29.883 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:29.881+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:30.076 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:30.073+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:30.876 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:30.873+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:31.123 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:31.120+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:31.905 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:31.903+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:32.113 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:32.110+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:32.890 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:32.888+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:33.092 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:33.090+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:33.917 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:33.915+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:34.093 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:34.090+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:34.932 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:34.929+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:35.059 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:35.057+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:35.963 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:35.961+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:36.055 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:36.053+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:36.967 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:36.965+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:37.078 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:37.075+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:37.967 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:37.965+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:38.103 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:38.101+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:38.945 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:38.943+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:39.146 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:39.144+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:39.989 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:39.987+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:40.101 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:40.099+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:41.001 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:40.999+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:41.076 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:41.073+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:41.999 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:41.996+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:42.079 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:42.077+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:43.033 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:43.031+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:43.123 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:43.121+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:44.053 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:44.051+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:44.118 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:44.116+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:45.079 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:45.077+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:45.113 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:45.111+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:46.051 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:46.048+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:46.081 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:46.079+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:47.099 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:47.097+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:47.099 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:47.097+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:48.073 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:48.070+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:48.101 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:48.099+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:49.040 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:49.037+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:49.137 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:49.135+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:50.078 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:50.075+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:50.102 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:50.100+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:51.058 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:51.056+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:51.061 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:51.059+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:52.096 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:52.092+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:52.097 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:52.094+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:53.093 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:53.089+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:53.142 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:53.138+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:54.065 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:54.061+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:54.097 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:54.094+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:55.034 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:55.030+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:55.099 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:55.096+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:56.059 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:56.056+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:56.083 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:56.079+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:57.021 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:57.018+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:57.035 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:57.032+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:58.015 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:58.012+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:44:58.032 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:58.030+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:59.031 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:44:59.028+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:44:59.060 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:44:59.057+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:00.004 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:00.001+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:00.072 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:00.070+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:01.011 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:01.009+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:01.043 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:01.040+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:01.991 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:01.989+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:02.009 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:02.006+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:03.032 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:03.029+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:03.037 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:03.035+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:04.058 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:04.055+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:04.075 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:04.073+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:05.055 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:05.052+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:05.065 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:05.063+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:06.071 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:06.069+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:06.072 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:06.070+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:07.087 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:07.085+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:07.088 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:07.086+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:08.069 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:08.067+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:08.109 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:08.107+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:09.087 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:09.084+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:09.124 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:09.122+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:10.116 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:10.113+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:10.145 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:10.143+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:11.099 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:11.097+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:11.153 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:11.151+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:12.109 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:12.107+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:12.128 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:12.125+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:13.131 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:13.128+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:13.162 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:13.159+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:14.149 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:14.147+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:14.157 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:14.155+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:15.107 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:15.104+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:15.197 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:15.195+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:16.144 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:16.142+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:16.171 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:16.168+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:17.167 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:17.165+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:17.215 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:17.213+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:18.119 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:18.117+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:18.262 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:18.260+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:19.091 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:19.089+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:19.248 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:19.246+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:20.133 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:20.130+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:20.279 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:20.277+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:21.098 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:21.096+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:21.326 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:21.324+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:22.137 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:22.134+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:22.351 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:22.348+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:23.146 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:23.143+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:23.313 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:23.310+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:24.098 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:24.095+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:24.359 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:24.356+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:25.096 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:25.093+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:25.409 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:25.407+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:26.077 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:26.075+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:26.364 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:26.362+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:27.085 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:27.083+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:27.377 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:27.374+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:28.098 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:28.096+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:28.329 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:28.327+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:29.115 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:29.113+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:29.309 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:29.307+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:30.097 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:30.095+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:30.283 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:30.281+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:31.112 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:31.109+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:31.298 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:31.295+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:32.127 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:32.125+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:32.281 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:32.279+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:33.116 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:33.114+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:33.275 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:33.272+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:34.097 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:34.094+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:34.237 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:34.233+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:35.137 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:35.134+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:35.269 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:35.266+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:36.168 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:36.165+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:36.285 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:36.282+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:37.152 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:37.149+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:37.245 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:37.242+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:38.197 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:38.193+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:38.239 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:38.235+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:39.175 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:39.171+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:39.199 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:39.195+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:40.194 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:40.191+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:40.209 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:40.206+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:41.146 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:41.143+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:41.240 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:41.236+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:42.139 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:42.135+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:42.260 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:42.257+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:43.160 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:43.157+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:43.258 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:43.255+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:44.203 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:44.200+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:44.243 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:44.241+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:45.189 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:45.186+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:45.277 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:45.275+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:46.185 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:46.183+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:46.247 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:46.245+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:47.225 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:47.223+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:47.254 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:47.252+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:48.238 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:48.236+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:48.244 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:48.242+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:49.225 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:49.223+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:49.226 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:49.224+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:50.198 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:50.196+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:50.208 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:50.206+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:51.191 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:51.189+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:51.193 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:51.190+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:52.178 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:52.175+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:52.215 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:52.213+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:53.224 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:53.222+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:53.265 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:53.263+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:54.245 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:54.242+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:54.246 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:54.244+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:55.230 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:55.227+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:55.230 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:55.227+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:56.182 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:56.179+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:56.275 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:56.273+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:57.180 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:57.177+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:57.253 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:57.250+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:58.212 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:58.210+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:58.230 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:58.227+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:45:59.213 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:45:59.210+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:45:59.252 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:45:59.250+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:00.231 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:00.228+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:00.299 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:00.296+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:01.231 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:01.228+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:01.250 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:01.248+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:02.230 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:02.228+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:02.237 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:02.235+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:03.185 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:03.183+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:03.287 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:03.285+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:04.206 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:04.204+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:04.297 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:04.294+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:05.169 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:05.167+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:05.302 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:05.299+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:06.218 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:06.216+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:06.261 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:06.259+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:07.192 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:07.190+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:07.221 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:07.219+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:08.206 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:08.203+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:08.220 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:08.217+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:09.192 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:09.190+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:09.245 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:09.243+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:10.171 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:10.169+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:10.248 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:10.245+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:11.206 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:11.204+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:11.223 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:11.221+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:12.237 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:12.235+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:12.245 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:12.243+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:13.232 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:13.230+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:13.269 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:13.267+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:14.231 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:14.229+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:14.246 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:14.244+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:15.187 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:15.184+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:15.209 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:15.207+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:16.164 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:16.162+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:16.221 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:16.219+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:17.142 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:17.138+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:17.240 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:17.237+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:18.103 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:18.099+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:18.196 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:18.193+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:19.061 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:19.057+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:19.173 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:19.169+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:20.062 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:20.059+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:20.216 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:20.213+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:21.069 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:21.066+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:21.213 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:21.210+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:22.116 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:22.112+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:22.227 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:22.224+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:23.087 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:23.083+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:23.269 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:23.265+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:24.080 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:24.077+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:24.225 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:24.221+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:25.042 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:25.039+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:25.208 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:25.205+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:26.053 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:26.051+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:26.194 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:26.192+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:27.008 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:27.006+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:27.165 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:27.162+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:28.043 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:28.041+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:28.129 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:28.126+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:29.033 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:29.031+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:29.091 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:29.089+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:30.071 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:30.069+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:30.091 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:30.089+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:31.115 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:31.113+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:31.130 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:31.128+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:32.096 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:32.093+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:32.113 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:32.111+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:33.117 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:33.114+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:33.123 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:33.121+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:34.117 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:34.115+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:34.123 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:34.121+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:35.107 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:35.105+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:35.120 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:35.117+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:36.115 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:36.112+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:36.143 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:36.141+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:37.121 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:37.119+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:37.140 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:37.137+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:38.103 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:38.101+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:38.160 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:38.158+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:39.081 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:39.079+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:39.163 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:39.161+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:40.037 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:40.035+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:40.160 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:40.157+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:41.025 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:41.022+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:41.118 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:41.116+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:42.075 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:42.073+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:42.132 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:42.130+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:43.101 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:43.099+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:43.106 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:43.104+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:44.055 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:44.053+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:44.152 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:44.149+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:45.014 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:45.012+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:45.201 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:45.199+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:45.982 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:45.979+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:46.208 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:46.206+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:47.003 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:47.000+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:47.179 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:47.176+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:48.009 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:48.007+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:48.203 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:48.200+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:49.023 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:49.021+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:49.212 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:49.209+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:49.982 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:49.980+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:50.175 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:50.173+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:51.015 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:51.012+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:51.147 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:51.145+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:52.048 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:52.046+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:52.191 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:52.188+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:53.029 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:53.026+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:53.189 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:53.187+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:54.045 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:54.042+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:54.145 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:54.143+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:55.056 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:55.054+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:55.154 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:55.151+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:56.023 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:56.020+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:56.120 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:56.117+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:57.047 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:57.045+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:57.123 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:57.120+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:58.078 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:58.075+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:58.117 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:58.115+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:46:59.046 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:46:59.043+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:46:59.136 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:46:59.133+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:00.021 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:00.017+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:00.105 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:00.101+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:01.047 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:01.044+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:01.055 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:01.052+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:02.042 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:02.038+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:02.045 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:02.042+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:03.047 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:03.044+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:03.081 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:03.078+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:04.049 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:04.046+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:04.054 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:04.050+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:05.048 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:05.044+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:05.074 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:05.070+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:06.054 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:06.051+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:06.079 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:06.076+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:07.009 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:07.005+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:07.068 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:07.065+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:08.059 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:08.055+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:08.104 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:08.100+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:09.062 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:09.060+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:09.128 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:09.125+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:10.107 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:10.105+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:10.112 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:10.110+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:11.122 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:11.120+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:11.136 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:11.134+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:12.082 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:12.080+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:12.143 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:12.140+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:13.094 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:13.092+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:13.106 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:13.104+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:14.090 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:14.088+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:14.143 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:14.141+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:15.042 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:15.040+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:15.125 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:15.122+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:16.075 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:16.073+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:16.144 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:16.141+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:17.050 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:17.048+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:17.177 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:17.175+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:18.005 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:18.003+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:18.206 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:18.204+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:18.995 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:18.992+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:19.216 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:19.214+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:19.982 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:19.979+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:20.194 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:20.191+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:20.974 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:20.972+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:21.220 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:21.218+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:21.988 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:21.986+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:22.184 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:22.182+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:22.992 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:22.990+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:23.210 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:23.208+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:24.019 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:24.017+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:24.217 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:24.215+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:25.064 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:25.062+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:25.207 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:25.204+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:26.050 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:26.047+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:26.235 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:26.232+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:27.053 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:27.050+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:27.282 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:27.280+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:28.027 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:28.024+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:28.290 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:28.286+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:29.060 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:29.058+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:29.240 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:29.237+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:30.098 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:30.096+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:30.249 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:30.246+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:31.066 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:31.064+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:31.240 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:31.237+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:32.111 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:32.108+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:32.198 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:32.196+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:33.115 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:33.113+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:33.210 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:33.208+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:34.085 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:34.083+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:34.233 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:34.231+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:35.114 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:35.112+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:35.220 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:35.218+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:36.114 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:36.111+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:36.205 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:36.203+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:37.069 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:37.066+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:37.205 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:37.203+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:38.063 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:38.061+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:38.181 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:38.178+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:39.104 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:39.101+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:39.197 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:39.195+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:40.147 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:40.145+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:40.202 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:40.200+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:41.157 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:41.155+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:41.196 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:41.194+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:42.194 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:42.192+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:42.204 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:42.202+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:43.149 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:43.145+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:43.156 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:43.153+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:44.106 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:44.102+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:44.196 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:44.193+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:45.142 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:45.138+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:45.242 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:45.239+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:46.129 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:46.125+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:46.210 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:46.206+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:47.178 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:47.175+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:47.229 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:47.226+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:48.220 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:48.216+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:48.222 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:48.219+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:49.228 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:49.225+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:49.260 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:49.256+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:50.179 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:50.176+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:50.240 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:50.236+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:51.191 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:51.188+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:51.243 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:51.240+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:52.167 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:52.165+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:52.199 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:52.196+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:53.121 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:53.119+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:53.153 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:53.151+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:54.099 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:54.097+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:54.121 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:54.118+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:55.130 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:55.128+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:55.144 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:55.141+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:56.085 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:56.083+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:56.131 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:56.129+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:57.106 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:57.100+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:57.133 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:57.131+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:58.118 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:58.115+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:58.120 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:58.118+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:47:59.095 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:47:59.093+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:47:59.134 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:47:59.131+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:00.092 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:00.089+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:00.183 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:00.181+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:01.110 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:01.108+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:01.176 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:01.174+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:02.089 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:02.087+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:02.183 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:02.181+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:03.088 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:03.086+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:03.144 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:03.142+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:04.097 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:04.094+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:04.107 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:04.105+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:05.062 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:05.059+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:05.103 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:05.101+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:06.071 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:06.069+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:06.097 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:06.094+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:07.052 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:07.050+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:07.115 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:07.112+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:08.094 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:08.091+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:08.159 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:08.156+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:09.087 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:09.085+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:09.125 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:09.122+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:10.063 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:10.061+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:10.166 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:10.164+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:11.108 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:11.106+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:11.211 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:11.208+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:12.096 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:12.093+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:12.174 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:12.171+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:13.056 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:13.053+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:13.219 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:13.217+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:14.073 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:14.069+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:14.216 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:14.214+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:15.033 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:15.028+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:15.250 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:15.247+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:16.061 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:16.059+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:16.232 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:16.206+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:17.055 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:17.052+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:17.160 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:17.157+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:18.074 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:18.071+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:18.203 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:18.201+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:19.041 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:19.038+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:19.242 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:19.240+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:20.071 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:20.068+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:20.206 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:20.203+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:21.116 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:21.113+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:21.197 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:21.194+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:22.084 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:22.081+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:22.158 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:22.155+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:23.043 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:23.041+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:23.116 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:23.114+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:24.000 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:23.997+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:24.124 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:24.122+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:24.975 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:24.972+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:25.110 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:25.107+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:25.936 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:25.932+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:26.089 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:26.086+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:26.915 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:26.912+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:27.120 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:27.116+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:27.870 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:27.866+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:28.114 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:28.110+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:28.896 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:28.892+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:29.115 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:29.112+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:29.859 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:29.855+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:30.125 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:30.122+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:30.863 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:30.859+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:31.109 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:31.105+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:31.886 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:31.882+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:32.129 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:32.126+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:32.884 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:32.880+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:33.154 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:33.151+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:33.839 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:33.836+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:34.123 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:34.120+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:34.804 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:34.802+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:35.088 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:35.086+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:35.832 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:35.829+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:36.076 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:36.073+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:36.825 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:36.823+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:37.049 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:37.047+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:37.791 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:37.788+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:38.015 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:38.012+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:38.820 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:38.817+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:39.002 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:39.000+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:39.792 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:39.790+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:40.002 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:40.000+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:40.801 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:40.798+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:41.009 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:41.006+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:41.837 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:41.835+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:42.045 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:42.042+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:42.839 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:42.836+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:43.080 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:43.077+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:43.843 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:43.841+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:44.034 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:44.031+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:44.853 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:44.850+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:45.014 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:45.012+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:45.851 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:45.849+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:46.032 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:46.030+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:46.803 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:46.800+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:47.054 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:47.052+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:47.824 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:47.822+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:48.082 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:48.080+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:48.782 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:48.780+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:49.120 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:49.118+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:49.805 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:49.803+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:50.108 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:50.106+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:50.783 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:50.780+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:51.081 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:51.079+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:51.736 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:51.734+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:52.077 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:52.075+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:52.734 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:52.731+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:53.122 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:53.119+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:53.719 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:53.717+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:54.167 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:54.164+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:54.715 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:54.712+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:55.141 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:55.139+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:55.744 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:55.741+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:56.165 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:56.162+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:56.703 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:56.701+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:57.163 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:57.161+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:57.671 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:57.668+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:58.195 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:58.193+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:58.693 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:58.690+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:48:59.206 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:48:59.203+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:48:59.720 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:48:59.718+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:00.174 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:00.172+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:00.713 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:00.710+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:01.218 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:01.216+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:01.693 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:01.690+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:02.195 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:02.192+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:02.694 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:02.692+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:03.158 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:03.155+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:03.739 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:03.736+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:04.178 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:04.175+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:04.737 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:04.734+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:05.142 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:05.140+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:05.699 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:05.696+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:06.139 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:06.136+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:06.694 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:06.691+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:07.129 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:07.126+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:07.732 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:07.729+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:08.167 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:08.164+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:08.768 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:08.764+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:09.143 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:09.139+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:09.724 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:09.720+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:10.169 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:10.165+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:10.680 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:10.677+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:11.150 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:11.146+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:11.694 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:11.691+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:12.132 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:12.128+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:12.660 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:12.657+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:13.095 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:13.092+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:13.691 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:13.687+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:14.071 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:14.067+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:14.689 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:14.686+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:15.038 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:15.034+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:15.678 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:15.674+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:16.047 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:16.044+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:16.655 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:16.651+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:17.010 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:17.008+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:17.653 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:17.651+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:17.992 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:17.990+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:18.606 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:18.604+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:18.990 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:18.987+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:19.654 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:19.651+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:19.956 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:19.954+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:20.651 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:20.649+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:20.991 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:20.988+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:21.686 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:21.683+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:22.016 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:22.013+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:22.684 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:22.682+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:23.033 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:23.030+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:23.698 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:23.695+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:24.012 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:24.010+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:24.702 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:24.699+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:25.059 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:25.057+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:25.744 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:25.741+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:26.018 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:26.016+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:26.725 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:26.722+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:26.998 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:26.995+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:27.718 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:27.716+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:28.017 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:28.014+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:28.707 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:28.704+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:29.010 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:29.008+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:29.728 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:29.726+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:30.027 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:30.024+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:30.713 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:30.710+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:31.009 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:31.006+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:31.738 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:31.735+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:32.059 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:32.056+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:32.723 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:32.720+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:33.056 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:33.053+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:33.677 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:33.675+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:34.012 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:34.009+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:34.720 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:34.718+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:35.034 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:35.032+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:35.687 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:35.685+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:36.010 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:36.008+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:36.657 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:36.654+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:36.992 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:36.989+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:37.619 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:37.617+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:37.958 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:37.955+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:38.636 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:38.633+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:38.933 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:38.931+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:39.652 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:39.649+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:39.922 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:39.920+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:40.678 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:40.675+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:40.918 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:40.915+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:41.652 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:41.649+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:41.936 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:41.933+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:42.661 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:42.658+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:42.977 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:42.974+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:43.622 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:43.619+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:43.968 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:43.966+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:44.661 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:44.659+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:44.991 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:44.989+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:45.681 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:45.678+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:46.011 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:46.008+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:46.715 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:46.712+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:47.006 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:47.004+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:47.678 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:47.676+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:47.995 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:47.993+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:48.708 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:48.706+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:48.975 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:48.972+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:49.723 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:49.720+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:49.977 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:49.975+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:50.744 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:50.740+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:51.000 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:50.996+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:51.756 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:51.752+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:51.953 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:51.949+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:52.707 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:52.704+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:52.908 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:52.905+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:53.740 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:53.736+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:53.933 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:53.930+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:54.704 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:54.701+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:54.977 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:54.973+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:55.713 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:55.709+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:55.993 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:55.989+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:56.733 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:56.729+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:57.027 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:57.024+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:57.695 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:57.691+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:58.060 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:58.057+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:58.736 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:58.732+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:49:59.050 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:49:59.046+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:49:59.715 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:49:59.712+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:00.048 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:00.045+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:00.742 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:00.739+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:01.097 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:01.094+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:01.742 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:01.739+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:02.108 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:02.106+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:02.760 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:02.757+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:03.090 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:03.088+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:03.803 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:03.800+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:04.135 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:04.132+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:04.777 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:04.775+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:05.172 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:05.170+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:05.731 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:05.728+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:06.177 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:06.175+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:06.740 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:06.737+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:07.164 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:07.161+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:07.715 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:07.712+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:08.180 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:08.177+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:08.677 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:08.674+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:09.147 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:09.145+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:09.712 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:09.709+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:10.153 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:10.151+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:10.753 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:10.750+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:11.187 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:11.185+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:11.717 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:11.715+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:12.166 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:12.163+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:12.693 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:12.691+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:13.178 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:13.176+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:13.677 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:13.675+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:14.130 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:14.127+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:14.675 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:14.673+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:15.158 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:15.156+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:15.714 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:15.712+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:16.131 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:16.129+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:16.733 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:16.730+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:17.162 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:17.159+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:17.774 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:17.771+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:18.185 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:18.183+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:18.786 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:18.783+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:19.145 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:19.142+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:19.747 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:19.744+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:20.188 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:20.185+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:20.713 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:20.710+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:21.164 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:21.162+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:21.756 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:21.753+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:22.206 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:22.203+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:22.744 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:22.741+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:23.214 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:23.211+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:23.762 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:23.760+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:24.227 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:24.225+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:24.718 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:24.716+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:25.191 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:25.189+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:25.684 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:25.681+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:26.238 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:26.236+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:26.717 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:26.715+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:27.267 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:27.265+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:27.698 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:27.696+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:28.267 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:28.264+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:28.727 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:28.724+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:29.238 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:29.235+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:29.725 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:29.722+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:30.243 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:30.240+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:30.702 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:30.700+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:31.260 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:31.258+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:31.752 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:31.749+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:32.300 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:32.297+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:32.757 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:32.754+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:33.335 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:33.332+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:33.779 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:33.775+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:34.329 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:34.325+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:34.789 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:34.785+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:35.378 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:35.374+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:35.761 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:35.758+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:36.336 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:36.332+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:36.758 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:36.754+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:37.335 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:37.332+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:37.782 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:37.779+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:38.333 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:38.330+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:38.753 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:38.749+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:39.343 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:39.339+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:39.718 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:39.714+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:40.358 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:40.355+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:40.719 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:40.716+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:41.315 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:41.311+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:41.743 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:41.740+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:42.320 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:42.317+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:42.766 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:42.764+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:43.293 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:43.290+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:43.766 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:43.763+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:44.296 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:44.294+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:44.735 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:44.732+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:45.259 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:45.257+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:45.760 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:45.757+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:46.249 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:46.246+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:46.778 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:46.776+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:47.293 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:47.289+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:47.818 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:47.816+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:48.274 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:48.271+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:48.839 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:48.836+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:49.279 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:49.276+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:49.874 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:49.871+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:50.287 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:50.285+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:50.838 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:50.836+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:51.264 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:51.261+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:51.817 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:51.815+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:52.298 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:52.296+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:52.773 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:52.771+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:53.313 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:53.311+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:53.809 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:53.806+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:54.337 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:54.335+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:54.802 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:54.800+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:55.350 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:55.347+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:55.818 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:55.816+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:56.312 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:56.309+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:56.823 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:56.820+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:57.304 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:57.301+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:57.809 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:57.806+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:58.320 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:58.317+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:58.858 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:58.855+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:50:59.362 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:50:59.360+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:50:59.835 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:50:59.832+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:00.397 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:00.394+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:00.786 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:00.783+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:01.364 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:01.362+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:01.777 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:01.775+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:02.338 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:02.335+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:02.732 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:02.730+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:03.322 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:03.320+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:03.767 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:03.764+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:04.329 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:04.327+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:04.764 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:04.762+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:05.364 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:05.362+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:05.716 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:05.714+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:06.383 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:06.380+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:06.688 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:06.685+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:07.383 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:07.380+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:07.672 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:07.669+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:08.336 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:08.333+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:08.688 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:08.686+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:09.291 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:09.288+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:09.737 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:09.734+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:10.276 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:10.273+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:10.747 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:10.744+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:11.295 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:11.293+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:11.701 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:11.698+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:12.337 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:12.334+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:12.685 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:12.682+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:13.366 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:13.364+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:13.728 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:13.726+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:14.342 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:14.339+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:14.697 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:14.694+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:15.364 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:15.361+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:15.691 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:15.688+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:16.374 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:16.370+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:16.728 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:16.725+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:17.342 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:17.338+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:17.707 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:17.704+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:18.391 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:18.387+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:18.741 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:18.737+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:19.429 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:19.425+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:19.749 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:19.745+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:20.406 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:20.403+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:20.789 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:20.785+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:21.445 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:21.441+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:21.767 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:21.760+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:22.482 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:22.478+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:22.756 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:22.752+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:23.447 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:23.443+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:23.734 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:23.730+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:24.449 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:24.445+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:24.761 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:24.757+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:25.408 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:25.405+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:25.803 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:25.801+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:26.384 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:26.381+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:26.776 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:26.773+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:27.335 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:27.333+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:27.762 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:27.760+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:28.305 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:28.302+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:28.805 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:28.803+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:29.285 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:29.282+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:29.799 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:29.796+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:30.291 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:30.288+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:30.843 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:30.840+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:31.329 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:31.327+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:31.825 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:31.823+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:32.326 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:32.324+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:32.778 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:32.776+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:33.358 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:33.355+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:33.770 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:33.767+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:34.356 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:34.353+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:34.735 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:34.733+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:35.337 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:35.334+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:35.713 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:35.711+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:36.313 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:36.310+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:36.675 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:36.672+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:37.314 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:37.311+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:37.636 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:37.633+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:38.336 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:38.334+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:38.589 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:38.586+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:39.313 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:39.310+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:39.611 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:39.608+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:40.279 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:40.276+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:40.632 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:40.630+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:41.242 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:41.240+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:41.653 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:41.651+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:42.270 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:42.267+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:42.612 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:42.609+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:43.300 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:43.297+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:43.609 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:43.606+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:44.304 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:44.301+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:44.650 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:44.648+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:45.266 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:45.263+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:45.640 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:45.637+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:46.268 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:46.265+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:46.639 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:46.636+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:47.250 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:47.247+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:47.628 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:47.626+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:48.294 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:48.291+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:48.612 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:48.610+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:49.269 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:49.266+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:49.573 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:49.570+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:50.228 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:50.226+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:50.621 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:50.618+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:51.185 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:51.182+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:51.607 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:51.604+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:52.159 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:52.157+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:52.634 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:52.631+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:53.191 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:53.188+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:53.670 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:53.667+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:54.181 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:54.179+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:54.707 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:54.704+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:55.194 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:55.192+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:55.756 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:55.753+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:56.152 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:56.150+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:56.719 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:56.716+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:57.170 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:57.167+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:57.722 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:57.719+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:58.132 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:58.130+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:58.679 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:58.675+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:51:59.090 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:51:59.087+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:51:59.689 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:51:59.685+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:00.051 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:00.047+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:00.700 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:00.696+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:01.022 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:01.018+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:01.699 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:01.696+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:01.979 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:01.975+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:02.724 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:02.720+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:02.952 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:02.948+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:03.761 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:03.758+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:03.990 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:03.986+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:04.785 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:04.781+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:04.962 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:04.958+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:05.806 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:05.802+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:05.998 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:05.994+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:06.770 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:06.768+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:07.029 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:07.025+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:07.817 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:07.814+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:08.046 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:08.043+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:08.776 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:08.773+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:09.040 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:09.038+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:09.747 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:09.745+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:10.056 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:10.053+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:10.705 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:10.703+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:11.025 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:11.023+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:11.686 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:11.683+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:12.013 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:12.010+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:12.662 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:12.659+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:13.053 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:13.051+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:13.663 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:13.660+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:14.071 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:14.069+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:14.679 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:14.676+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:15.091 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:15.089+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:15.649 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:15.646+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:16.072 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:16.069+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:16.626 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:16.624+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:17.034 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:17.031+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:17.668 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:17.665+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:18.075 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:18.072+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:18.686 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:18.683+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:19.120 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:19.117+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:19.643 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:19.641+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:20.087 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:20.084+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:20.680 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:20.678+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:21.117 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:21.115+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:21.660 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:21.657+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:22.103 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:22.100+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:22.645 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:22.641+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:23.115 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:23.112+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:23.603 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:23.600+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:24.107 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:24.105+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:24.585 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:24.582+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:25.127 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:25.124+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:25.546 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:25.543+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:26.088 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:26.085+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:26.574 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:26.571+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:27.084 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:27.082+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:27.580 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:27.577+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:28.051 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:28.049+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:28.561 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:28.558+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:29.066 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:29.063+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:29.569 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:29.567+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:30.038 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:30.035+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:30.529 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:30.526+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:31.052 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:31.049+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:31.545 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:31.542+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:32.092 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:32.089+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:32.591 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:32.588+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:33.082 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:33.079+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:33.623 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:33.620+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:34.095 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:34.093+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:34.652 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:34.650+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:35.137 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:35.134+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:35.615 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:35.613+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:36.141 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:36.139+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:36.655 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:36.652+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:37.162 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:37.159+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:37.624 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:37.621+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:38.172 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:38.169+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:38.605 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:38.602+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:39.206 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:39.203+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:39.647 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:39.645+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:40.191 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:40.188+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:40.624 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:40.621+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:41.197 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:41.194+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:41.626 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:41.622+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:42.149 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:42.146+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:42.622 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:42.618+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:43.190 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:43.186+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:43.617 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:43.614+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:44.168 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:44.165+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:44.629 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:44.626+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:45.177 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:45.172+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:45.626 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:45.622+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:46.174 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:46.170+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:46.605 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:46.602+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:47.157 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:47.153+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:47.587 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:47.584+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:48.159 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:48.155+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:48.539 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:48.536+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:49.164 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:49.160+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:49.537 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:49.533+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:50.127 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:50.124+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:50.586 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:50.583+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:51.133 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:51.130+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:51.620 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:51.618+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:52.105 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:52.102+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:52.593 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:52.590+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:53.121 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:53.118+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:53.564 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:53.561+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:54.153 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:54.150+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:54.523 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:54.520+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:55.109 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:55.106+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:55.545 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:55.542+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:56.113 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:56.110+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:56.563 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:56.560+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:57.090 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:57.087+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:57.541 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:57.538+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:58.138 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:58.135+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:58.566 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:58.563+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:52:59.139 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:52:59.136+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:52:59.530 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:52:59.528+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:00.149 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:00.146+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:00.502 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:00.499+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:01.177 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:01.174+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:01.455 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:01.452+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:02.167 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:02.164+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:02.406 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:02.403+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:03.162 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:03.160+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:03.360 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:03.357+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:04.177 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:04.174+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:04.360 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:04.357+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:05.138 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:05.136+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:05.396 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:05.393+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:06.105 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:06.102+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:06.438 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:06.436+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:07.143 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:07.140+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:07.445 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:07.442+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:08.109 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:08.106+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:08.483 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:08.480+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:09.101 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:09.098+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:09.494 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:09.491+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:10.125 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:10.120+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:10.505 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:10.502+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:11.169 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:11.167+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:11.502 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:11.499+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:12.193 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:12.191+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:12.510 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:12.507+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:13.220 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:13.217+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:13.531 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:13.528+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:14.261 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:14.258+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:14.528 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:14.525+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:15.239 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:15.236+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:15.516 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:15.514+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:16.298 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:16.269+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:16.557 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:16.555+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:17.261 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:17.258+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:17.526 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:17.523+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:18.289 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:18.287+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:18.532 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:18.529+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:19.250 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:19.248+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:19.534 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:19.531+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:20.251 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:20.248+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:20.519 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:20.516+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:21.278 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:21.276+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:21.530 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:21.527+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:22.321 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:22.318+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:22.514 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:22.512+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:23.287 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:23.284+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:23.470 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:23.466+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:24.313 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:24.309+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:24.483 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:24.479+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:25.334 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:25.330+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:25.451 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:25.447+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:26.373 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:26.369+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:26.420 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:26.417+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:27.325 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:27.321+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:27.390 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:27.386+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:28.353 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:28.349+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:28.412 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:28.408+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:29.345 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:29.341+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:29.430 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:29.426+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:30.365 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:30.361+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:30.410 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:30.407+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:31.389 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:31.385+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:31.411 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:31.408+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:32.378 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:32.374+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:32.459 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:32.455+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:33.356 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:33.353+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:33.466 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:33.463+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:34.357 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:34.354+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:34.471 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:34.468+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:35.407 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:35.404+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:35.501 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:35.498+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:36.412 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:36.410+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:36.471 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:36.468+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:37.391 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:37.388+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:37.427 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:37.424+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:38.402 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:38.399+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:38.428 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:38.426+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:39.413 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:39.410+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:39.442 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:39.440+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:40.429 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:40.426+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:40.442 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:40.440+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:41.436 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:41.433+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:41.491 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:41.488+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:42.398 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:42.396+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:42.539 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:42.537+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:43.420 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:43.418+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:43.558 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:43.556+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:44.381 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:44.378+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:44.534 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:44.532+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:45.342 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:45.339+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:45.517 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:45.514+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:46.323 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:46.321+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:46.553 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:46.550+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:47.356 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:47.353+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:47.566 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:47.563+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:48.377 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:48.375+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:48.550 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:48.547+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:49.424 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:49.422+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:49.588 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:49.585+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:50.381 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:50.378+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:50.554 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:50.551+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:51.389 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:51.386+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:51.579 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:51.576+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:52.411 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:52.408+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:52.550 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:52.547+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:53.404 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:53.401+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:53.538 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:53.535+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:54.399 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:54.396+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:54.506 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:54.503+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:55.393 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:55.390+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:55.532 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:55.529+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:56.416 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:56.413+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:56.513 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:56.511+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:57.395 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:57.392+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:57.509 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:57.506+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:58.437 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:58.434+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:58.502 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:58.500+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:53:59.415 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:53:59.412+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:53:59.503 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:53:59.501+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:00.369 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:00.366+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:00.551 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:00.548+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:01.401 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:01.398+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:01.519 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:01.516+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:02.439 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:02.436+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:02.536 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:02.533+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:03.436 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:03.433+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:03.517 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:03.514+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:04.390 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:04.387+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:04.556 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:04.553+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:05.396 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:05.394+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:05.511 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:05.509+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:06.446 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:06.443+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:06.505 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:06.501+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:07.440 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:07.437+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:07.554 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:07.551+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:08.449 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:08.446+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:08.548 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:08.544+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:09.402 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:09.398+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:09.502 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:09.498+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:10.359 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:10.355+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:10.463 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:10.459+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:11.369 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:11.365+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:11.496 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:11.493+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:12.402 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:12.397+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:12.484 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:12.480+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:13.354 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:13.350+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:13.512 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:13.508+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:14.309 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:14.306+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:14.547 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:14.544+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:15.267 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:15.264+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:15.536 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:15.533+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:16.266 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:16.264+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:16.492 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:16.489+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:17.260 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:17.257+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:17.503 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:17.500+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:18.273 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:18.271+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:18.546 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:18.543+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:19.308 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:19.305+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:19.504 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:19.501+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:20.263 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:20.260+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:20.486 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:20.483+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:21.288 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:21.285+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:21.474 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:21.471+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:22.325 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:22.322+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:22.464 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:22.462+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:23.324 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:23.322+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:23.484 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:23.481+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:24.295 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:24.292+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:24.473 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:24.470+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:25.296 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:25.294+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:25.498 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:25.496+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:26.315 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:26.312+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:26.495 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:26.492+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:27.281 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:27.278+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:27.466 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:27.463+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:28.264 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:28.261+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:28.422 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:28.419+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:29.239 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:29.236+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:29.400 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:29.398+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:30.201 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:30.198+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:30.417 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:30.412+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:31.223 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:31.220+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:31.392 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:31.390+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:32.268 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:32.266+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:32.435 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:32.432+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:33.303 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:33.300+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:33.466 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:33.463+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:34.279 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:34.276+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:34.495 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:34.492+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:35.289 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:35.286+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:35.492 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:35.489+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:36.302 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:36.299+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:36.488 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:36.485+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:37.273 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:37.270+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:37.532 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:37.530+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:38.301 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:38.298+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:38.511 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:38.509+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:39.294 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:39.291+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:39.515 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:39.512+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:40.258 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:40.256+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:40.509 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:40.506+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:41.239 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:41.236+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:41.530 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:41.527+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:42.248 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:42.245+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:42.540 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:42.538+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:43.293 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:43.290+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:43.566 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:43.563+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:44.317 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:44.314+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:44.572 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:44.569+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:45.273 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:45.270+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:45.529 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:45.526+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:46.308 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:46.305+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:46.553 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:46.550+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:47.284 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:47.281+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:47.603 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:47.600+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:48.308 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:48.305+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:48.646 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:48.642+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:49.313 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:49.309+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:49.690 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:49.687+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:50.351 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:50.348+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:50.699 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:50.695+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:51.355 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:51.351+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:51.719 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:51.715+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:52.394 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:52.391+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:52.735 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:52.731+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:53.405 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:53.401+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:53.762 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:53.758+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:54.388 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:54.385+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:54.720 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:54.716+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:55.349 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:55.345+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:55.683 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:55.679+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:56.339 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:56.336+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:56.645 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:56.641+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:57.339 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:57.336+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:57.685 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:57.682+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:58.322 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:58.319+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:58.668 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:58.665+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:54:59.341 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:54:59.338+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:54:59.682 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:54:59.680+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:00.340 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:00.338+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:00.721 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:00.718+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:01.363 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:01.361+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:01.706 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:01.703+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:02.361 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:02.358+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:02.701 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:02.698+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:03.333 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:03.330+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:03.738 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:03.736+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:04.339 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:04.336+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:04.772 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:04.769+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:05.305 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:05.302+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:05.791 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:05.789+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:06.285 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:06.282+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:06.834 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:06.831+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:07.253 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:07.250+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:07.797 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:07.794+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:08.221 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:08.218+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:08.811 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:08.808+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:09.224 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:09.221+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:09.804 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:09.801+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:10.186 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:10.183+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:10.757 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:10.754+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:11.223 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:11.220+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:11.784 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:11.782+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:12.217 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:12.214+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:12.799 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:12.796+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:13.180 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:13.177+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:13.800 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:13.797+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:14.229 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:14.226+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:14.781 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:14.779+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:15.227 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:15.224+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:15.779 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:15.776+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:16.179 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:16.176+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:16.761 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:16.758+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:17.178 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:17.175+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:17.767 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:17.764+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:18.189 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:18.186+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:18.754 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:18.751+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:19.211 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:19.208+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:19.776 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:19.773+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:20.210 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:20.207+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:20.745 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:20.742+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:21.165 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:21.163+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:21.727 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:21.724+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:22.141 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:22.138+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:22.685 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:22.682+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:23.160 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:23.157+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:23.673 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:23.670+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:24.163 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:24.160+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:24.673 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:24.671+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:25.159 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:25.156+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:25.722 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:25.720+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:26.179 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:26.176+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:26.740 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:26.737+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:27.179 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:27.176+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:27.702 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:27.699+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:28.215 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:28.212+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:28.751 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:28.748+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:29.263 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:29.260+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:29.798 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:29.795+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:30.263 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:30.260+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:30.773 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:30.770+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:31.280 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:31.276+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:31.771 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:31.767+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:32.270 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:32.266+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:32.790 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:32.786+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:33.254 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:33.250+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:33.807 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:33.803+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:34.251 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:34.247+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:34.847 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:34.843+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:35.205 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:35.201+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:35.861 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:35.857+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:36.206 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:36.203+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:36.906 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:36.902+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:37.189 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:37.185+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:37.926 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:37.923+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:38.140 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:38.137+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:38.892 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:38.888+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:39.099 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:39.095+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:39.886 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:39.882+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:40.086 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:40.082+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:40.897 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:40.894+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:41.098 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:41.095+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:41.889 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:41.886+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:42.060 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:42.058+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:42.867 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:42.864+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:43.072 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:43.069+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:43.896 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:43.893+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:44.103 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:44.100+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:44.882 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:44.879+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:45.116 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:45.113+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:45.838 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:45.835+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:46.089 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:46.086+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:46.878 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:46.875+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:47.116 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:47.113+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:47.869 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:47.866+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:48.166 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:48.163+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:48.864 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:48.861+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:49.118 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:49.115+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:49.879 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:49.876+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:50.089 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:50.086+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:50.872 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:50.869+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:51.128 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:51.125+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:51.904 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:51.901+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:52.145 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:52.142+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:52.857 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:52.854+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:53.139 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:53.136+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:53.889 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:53.886+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:54.188 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:54.185+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:54.911 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:54.908+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:55.203 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:55.200+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:55.885 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:55.882+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:56.160 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:56.157+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:56.850 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:56.847+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:57.137 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:57.134+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:57.834 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:57.831+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:58.162 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:58.160+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:58.882 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:58.879+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:55:59.136 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:55:59.133+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:55:59.856 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:55:59.853+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:00.150 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:00.147+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:00.844 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:00.841+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:01.156 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:01.153+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:01.852 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:01.849+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:02.145 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:02.142+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:02.807 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:02.805+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:03.111 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:03.108+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:03.853 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:03.851+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:04.154 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:04.151+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:04.861 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:04.859+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:05.195 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:05.193+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:05.869 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:05.867+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:06.170 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:06.167+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:06.828 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:06.825+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:07.182 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:07.179+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:07.802 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:07.799+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:08.188 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:08.185+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:08.771 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:08.768+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:09.227 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:09.224+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:09.794 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:09.791+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:10.272 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:10.269+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:10.797 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:10.795+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:11.263 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:11.260+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:11.753 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:11.750+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:12.312 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:12.309+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:12.719 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:12.716+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:13.290 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:13.287+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:13.703 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:13.699+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:14.331 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:14.327+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:14.749 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:14.746+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:15.306 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:15.302+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:15.791 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:15.787+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:16.313 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:16.309+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:16.819 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:16.815+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:17.335 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:17.332+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:17.788 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:17.784+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:18.372 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:18.368+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:18.742 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:18.738+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:19.346 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:19.342+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:19.730 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:19.726+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:20.297 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:20.293+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:20.745 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:20.742+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:21.332 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:21.328+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:21.777 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:21.773+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:22.363 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:22.359+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:22.748 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:22.745+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:23.390 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:23.387+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:23.747 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:23.744+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:24.416 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:24.413+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:24.777 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:24.774+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:25.417 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:25.414+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:25.804 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:25.801+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:26.460 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:26.457+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:26.849 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:26.846+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:27.450 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:27.447+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:27.888 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:27.885+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:28.458 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:28.455+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:28.931 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:28.928+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:29.464 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:29.461+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:29.898 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:29.895+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:30.430 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:30.427+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:30.906 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:30.903+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:31.481 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:31.478+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:31.857 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:31.854+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:32.483 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:32.480+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:32.835 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:32.832+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:33.496 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:33.493+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:33.871 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:33.869+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:34.455 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:34.452+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:34.892 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:34.889+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:35.440 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:35.437+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:35.858 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:35.855+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:36.480 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:36.477+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:36.835 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:36.833+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:37.439 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:37.436+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:37.793 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:37.790+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:38.406 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:38.403+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:38.768 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:38.765+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:39.451 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:39.448+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:39.780 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:39.777+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:40.441 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:40.438+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:40.798 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:40.795+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:41.427 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:41.424+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:41.844 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:41.841+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:42.387 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:42.384+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:42.854 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:42.851+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:43.436 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:43.433+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:43.873 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:43.870+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:44.409 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:44.406+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:44.897 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:44.894+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:45.372 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:45.369+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:45.934 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:45.931+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:46.405 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:46.402+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:46.984 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:46.981+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:47.369 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:47.367+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:47.984 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:47.981+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:48.377 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:48.374+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:49.003 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:49.000+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:49.337 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:49.334+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:50.042 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:50.039+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:50.302 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:50.298+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:51.088 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:51.085+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:51.310 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:51.307+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:52.131 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:52.128+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:52.328 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:52.326+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:53.153 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:53.151+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:53.371 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:53.368+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:54.113 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:54.111+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:54.414 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:54.411+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:55.084 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:55.081+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:55.440 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:55.438+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:56.093 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:56.089+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:56.419 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:56.415+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:57.093 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:57.089+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:57.416 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:57.412+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:58.137 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:58.133+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:58.378 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:58.374+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:56:59.098 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:56:59.093+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:56:59.397 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:56:59.393+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:00.064 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:00.060+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:00.426 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:00.422+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:01.024 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:01.020+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:01.394 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:01.390+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:02.021 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:02.017+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:02.415 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:02.411+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:03.007 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:03.003+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:03.395 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:03.391+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:04.025 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:04.021+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:04.414 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:04.411+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:05.057 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:05.053+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:05.425 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:05.422+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:06.042 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:06.039+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:06.433 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:06.430+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:07.066 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:07.063+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:07.469 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:07.464+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:08.036 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:08.034+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:08.433 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:08.430+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:09.084 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:09.081+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:09.460 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:09.457+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:10.072 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:10.069+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:10.432 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:10.429+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:11.107 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:11.104+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:11.425 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:11.422+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:12.107 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:12.104+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:12.465 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:12.462+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:13.154 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:13.151+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:13.453 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:13.450+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:14.118 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:14.115+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:14.498 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:14.495+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:15.154 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:15.151+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:15.482 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:15.477+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:16.155 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:16.152+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:16.498 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:16.495+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:17.111 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:17.108+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:17.458 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:17.455+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:18.146 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:18.143+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:18.493 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:18.490+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:19.182 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:19.179+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:19.539 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:19.536+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:20.158 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:20.155+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:20.523 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:20.520+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:21.180 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:21.177+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:21.566 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:21.563+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:22.179 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:22.176+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:22.561 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:22.558+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:23.197 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:23.194+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:23.527 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:23.524+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:24.196 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:24.193+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:24.486 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:24.483+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:25.200 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:25.197+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:25.457 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:25.454+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:26.153 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:26.150+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:26.446 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:26.443+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:27.196 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:27.193+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:27.438 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:27.436+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:28.196 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:28.193+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:28.435 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:28.432+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:29.179 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:29.176+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:29.405 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:29.402+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:30.201 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:30.198+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:30.395 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:30.392+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:31.208 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:31.205+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:31.445 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:31.443+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:32.163 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:32.160+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:32.490 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:32.487+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:33.182 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:33.179+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:33.449 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:33.446+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:34.194 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:34.191+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:34.454 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:34.451+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:35.153 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:35.150+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:35.409 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:35.406+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:36.144 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:36.141+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:36.393 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:36.390+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:37.166 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:37.163+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:37.370 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:37.368+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:38.210 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:38.207+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:38.413 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:38.410+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:39.248 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:39.244+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:39.379 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:39.375+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:40.253 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:40.249+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:40.338 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:40.334+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:41.302 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:41.297+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:41.322 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:41.317+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:42.337 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:42.333+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:42.342 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:42.339+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:43.335 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:43.331+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:43.368 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:43.364+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:44.305 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:44.301+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:44.332 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:44.328+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:45.324 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:45.320+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:45.365 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:45.361+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:46.316 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:46.312+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:46.320 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:46.316+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:47.292 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:47.288+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:47.358 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:47.354+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:48.271 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:48.268+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:48.342 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:48.339+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:49.321 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:49.318+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:49.346 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:49.344+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:50.333 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:50.329+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:50.354 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:50.351+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:51.366 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:51.364+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:51.369 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:51.366+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:52.354 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:52.352+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:52.383 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:52.380+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:53.313 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:53.310+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:53.374 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:53.372+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:54.296 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:54.293+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:54.384 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:54.381+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:55.323 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:55.319+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:55.394 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:55.392+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:56.313 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:56.310+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:56.405 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:56.402+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:57.340 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:57.337+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:57.423 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:57.420+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:58.347 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:58.344+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:58.471 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:58.468+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:57:59.302 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:57:59.299+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:57:59.449 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:57:59.446+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:00.335 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:00.332+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:00.440 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:00.437+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:01.337 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:01.334+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:01.446 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:01.443+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:02.366 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:02.363+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:02.475 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:02.472+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:03.344 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:03.341+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:03.521 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:03.518+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:04.344 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:04.341+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:04.485 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:04.482+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:05.384 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:05.381+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:05.454 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:05.451+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:06.356 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:06.353+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:06.416 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:06.413+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:07.380 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:07.377+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:07.385 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:07.382+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:08.381 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:08.378+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:08.381 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:08.378+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:09.343 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:09.340+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:09.407 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:09.404+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:10.363 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:10.360+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:10.386 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:10.383+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:11.384 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:11.381+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:11.385 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:11.382+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:12.359 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:12.356+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:12.411 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:12.408+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:13.325 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:13.322+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:13.403 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:13.400+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:14.303 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:14.300+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:14.393 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:14.390+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:15.347 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:15.344+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:15.388 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:15.385+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:16.367 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:16.363+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:16.435 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:16.432+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:17.366 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:17.363+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:17.408 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:17.405+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:18.363 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:18.360+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:18.415 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:18.412+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:19.389 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:19.386+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:19.410 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:19.408+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:20.395 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:20.392+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:20.426 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:20.423+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:21.379 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:21.375+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:21.386 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:21.382+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:22.373 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:22.369+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:22.377 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:22.372+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:23.369 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:23.365+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:23.380 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:23.377+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:24.390 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:24.386+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:24.405 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:24.401+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:25.390 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:25.386+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:25.421 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:25.417+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:26.377 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:26.373+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:26.454 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:26.450+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:27.328 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:27.324+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:27.498 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:27.494+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:28.336 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:28.333+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:28.500 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:28.496+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:29.350 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:29.346+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:29.528 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:29.525+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:30.357 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:30.354+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:30.522 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:30.520+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:31.322 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:31.319+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:31.496 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:31.493+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:32.304 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:32.301+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:32.466 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:32.463+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:33.287 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:33.284+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:33.514 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:33.511+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:34.250 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:34.247+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:34.554 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:34.551+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:35.233 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:35.230+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:35.516 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:35.513+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:36.224 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:36.221+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:36.474 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:36.471+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:37.204 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:37.201+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:37.451 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:37.448+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:38.166 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:38.163+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:38.444 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:38.441+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:39.200 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:39.197+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:39.476 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:39.473+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:40.166 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:40.163+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:40.509 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:40.506+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:41.156 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:41.153+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:41.528 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:41.525+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:42.128 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:42.125+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:42.537 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:42.534+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:43.174 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:43.171+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:43.540 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:43.537+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:44.150 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:44.147+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:44.494 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:44.491+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:45.125 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:45.122+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:45.466 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:45.463+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:46.123 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:46.120+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:46.454 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:46.451+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:47.084 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:47.081+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:47.447 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:47.444+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:48.074 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:48.071+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:48.451 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:48.448+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:49.094 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:49.091+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:49.437 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:49.434+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:50.116 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:50.113+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:50.470 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:50.467+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:51.145 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:51.142+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:51.481 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:51.478+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:52.162 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:52.159+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:52.521 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:52.518+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:53.152 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:53.149+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:53.524 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:53.521+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:54.116 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:54.113+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:54.542 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:54.538+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:55.112 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:55.109+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:55.498 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:55.495+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:56.090 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:56.087+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:56.512 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:56.509+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:57.110 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:57.107+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:57.560 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:57.557+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:58.085 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:58.082+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:58.537 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:58.534+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:58:59.124 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:58:59.121+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:58:59.527 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:58:59.524+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:00.154 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:00.151+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:00.492 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:00.489+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:01.151 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:01.148+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:01.535 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:01.533+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:02.179 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:02.176+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:02.529 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:02.526+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:03.181 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:03.178+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:03.537 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:03.534+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:04.170 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:04.166+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:04.569 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:04.565+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:05.124 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:05.120+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:05.535 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:05.531+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:06.171 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:06.167+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:06.494 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:06.490+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:07.143 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:07.139+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:07.524 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:07.520+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:08.097 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:08.092+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:08.487 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:08.483+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:09.109 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:09.105+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:09.474 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:09.470+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:10.073 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:10.070+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:10.496 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:10.492+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:11.098 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:11.094+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:11.447 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:11.444+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:12.104 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:12.100+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:12.419 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:12.416+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:13.136 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:13.133+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:13.402 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:13.399+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:14.106 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:14.103+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:14.381 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:14.378+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:15.102 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:15.099+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:15.410 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:15.407+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:16.124 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:16.121+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:16.447 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:16.444+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:17.091 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:17.088+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:17.426 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:17.423+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:18.095 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:18.092+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:18.399 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:18.396+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:19.053 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:19.050+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:19.440 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:19.437+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:20.066 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:20.063+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:20.474 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:20.472+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:21.038 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:21.035+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:21.481 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:21.478+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:22.069 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:22.066+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:22.469 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:22.466+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:23.082 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:23.079+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:23.470 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:23.467+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:24.108 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:24.105+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:24.435 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:24.432+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:25.090 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:25.087+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:25.471 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:25.468+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:26.050 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:26.047+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:26.466 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:26.463+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:27.051 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:27.048+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:27.496 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:27.493+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:28.070 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:28.067+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:28.496 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:28.493+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:29.026 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:29.023+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:29.510 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:29.507+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:30.072 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:30.069+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:30.473 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:30.470+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:31.032 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:31.029+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:31.498 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:31.495+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:32.077 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:32.074+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:32.472 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:32.469+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:33.106 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:33.103+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:33.474 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:33.471+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:34.145 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:34.142+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:34.478 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:34.475+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:35.162 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:35.159+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:35.481 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:35.478+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:36.165 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:36.162+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:36.450 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:36.447+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:37.148 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:37.144+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:37.450 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:37.447+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:38.129 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:38.126+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:38.452 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:38.449+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:39.165 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:39.162+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:39.471 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:39.468+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:40.156 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:40.153+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:40.518 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:40.515+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:41.166 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:41.163+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:41.566 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:41.563+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:42.214 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:42.211+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:42.541 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:42.538+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:43.168 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:43.165+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:43.561 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:43.558+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:44.189 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:44.186+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:44.538 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:44.535+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:45.194 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:45.191+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:45.539 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:45.536+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:46.147 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:46.144+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:46.562 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:46.558+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:47.146 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:47.142+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:47.535 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:47.531+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:48.128 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:48.124+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:48.584 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:48.580+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:49.136 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:49.132+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:49.588 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:49.584+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:50.114 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:50.110+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:50.617 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:50.613+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:51.109 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:51.105+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:51.666 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:51.662+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:52.129 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:52.125+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:52.650 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:52.646+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:53.107 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:53.103+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:53.642 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:53.638+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:54.089 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:54.085+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:54.693 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:54.689+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:55.096 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:55.092+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:55.721 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:55.718+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:56.063 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:56.060+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:56.714 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:56.711+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:57.026 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:57.024+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:57.723 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:57.720+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:58.009 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:58.006+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:58.769 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:58.766+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T17:59:58.974 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T17:59:58.971+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T17:59:59.817 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T17:59:59.814+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:00.017 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:00.014+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:00.809 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:00.806+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:01.052 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:01.049+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:01.802 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:01.799+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:02.015 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:02.012+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:02.822 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:02.819+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:02.989 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:02.986+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:03.779 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:03.776+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:03.966 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:03.963+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:04.808 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:04.805+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:05.000 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:04.997+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:05.812 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:05.809+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:06.015 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:06.012+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:06.827 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:06.824+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:06.971 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:06.968+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:07.836 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:07.833+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:07.939 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:07.936+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:08.812 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:08.809+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:08.986 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:08.983+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:09.845 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:09.842+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:09.999 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:09.996+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:10.844 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:10.841+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:10.987 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:10.984+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:11.872 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:11.869+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:11.978 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:11.975+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:12.853 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:12.850+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:12.961 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:12.958+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:13.813 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:13.810+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:13.914 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:13.911+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:14.776 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:14.773+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:14.931 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:14.928+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:15.757 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:15.754+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:15.978 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:15.975+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:16.759 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:16.756+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:16.950 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:16.947+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:17.713 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:17.710+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:17.915 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:17.912+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:18.744 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:18.741+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:18.931 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:18.928+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:19.702 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:19.699+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:19.914 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:19.911+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:20.693 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:20.690+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:20.880 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:20.877+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:21.726 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:21.723+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:21.861 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:21.858+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:22.761 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:22.758+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:22.845 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:22.842+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:23.724 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:23.721+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:23.858 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:23.855+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:24.726 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:24.723+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:24.837 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:24.834+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:25.681 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:25.678+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:25.792 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:25.789+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:26.634 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:26.630+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:26.766 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:26.763+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:27.678 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:27.675+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:27.811 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:27.808+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:28.702 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:28.699+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:28.847 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:28.843+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:29.731 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:29.727+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:29.863 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:29.859+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:30.773 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:30.769+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:30.841 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:30.837+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:31.725 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:31.721+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:31.844 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:31.840+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:32.710 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:32.705+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:32.885 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:32.881+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:33.743 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:33.739+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:33.887 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:33.883+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:34.761 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:34.756+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:34.845 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:34.841+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:35.772 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:35.768+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:35.895 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:35.891+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:36.816 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:36.812+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:36.870 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:36.866+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:37.833 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:37.829+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:37.880 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:37.876+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:38.798 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:38.795+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:38.906 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:38.903+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:39.786 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:39.782+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:39.928 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:39.925+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:40.750 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:40.747+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:40.897 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:40.894+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:41.758 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:41.755+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:41.879 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:41.876+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:42.776 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:42.772+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:42.858 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:42.852+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:43.799 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:43.795+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:43.837 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:43.834+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:44.845 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:44.842+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:44.860 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:44.857+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:45.819 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:45.816+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:45.841 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:45.838+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:46.800 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:46.797+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:46.850 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:46.847+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:47.803 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:47.800+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:47.843 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:47.840+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:48.849 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:48.846+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:48.852 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:48.849+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:49.811 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:49.808+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:49.844 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:49.841+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:50.788 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:50.785+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:50.827 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:50.824+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:51.811 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:51.808+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:51.826 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:51.823+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:52.844 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:52.841+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:52.876 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:52.873+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:53.829 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:53.826+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:53.842 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:53.839+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:54.806 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:54.803+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:54.812 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:54.810+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:55.765 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:55.762+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:55.792 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:55.789+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:56.742 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:56.739+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:56.766 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:56.763+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:57.716 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:57.713+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:57.770 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:57.767+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:58.713 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:58.710+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:00:58.728 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:58.725+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:59.697 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:00:59.694+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:00:59.748 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:00:59.745+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:00.745 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:00.741+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:00.749 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:00.746+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:01.778 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:01.775+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:01.790 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:01.787+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:02.751 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:02.748+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:02.829 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:02.826+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:03.788 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:03.784+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:03.863 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:03.860+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:04.766 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:04.763+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:04.898 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:04.895+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:05.769 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:05.766+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:05.902 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:05.899+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:06.740 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:06.737+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:06.922 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:06.919+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:07.716 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:07.713+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:07.921 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:07.918+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:08.698 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:08.695+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:08.951 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:08.948+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:09.672 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:09.669+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:09.981 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:09.978+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:10.684 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:10.681+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:10.982 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:10.979+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:11.704 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:11.700+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:12.013 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:12.009+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:12.661 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:12.657+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:13.017 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:13.013+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:13.612 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:13.608+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:13.982 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:13.978+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:14.602 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:14.598+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:14.977 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:14.973+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:15.646 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:15.642+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:15.981 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:15.977+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:16.646 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:16.642+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:16.950 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:16.946+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:17.681 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:17.677+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:17.969 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:17.965+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:18.667 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:18.663+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:18.996 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:18.992+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:19.686 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:19.682+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:19.962 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:19.958+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:20.658 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:20.654+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:20.969 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:20.966+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:21.685 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:21.681+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:22.016 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:22.012+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:22.675 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:22.672+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:23.014 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:23.011+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:23.671 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:23.668+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:23.998 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:23.995+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:24.709 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:24.706+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:24.980 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:24.977+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:25.755 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:25.752+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:25.935 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:25.932+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:26.721 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:26.718+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:26.894 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:26.890+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:27.752 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:27.749+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:27.916 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:27.913+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:28.714 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:28.711+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:28.918 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:28.915+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:29.746 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:29.743+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:29.876 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:29.873+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:30.795 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:30.792+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:30.864 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:30.861+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:31.838 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:31.834+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:31.902 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:31.899+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:32.851 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:32.848+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:32.928 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:32.925+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:33.873 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:33.870+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:33.941 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:33.938+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:34.881 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:34.878+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:34.918 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:34.915+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:35.906 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:35.903+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:35.911 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:35.908+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:36.906 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:36.903+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:36.949 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:36.946+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:37.884 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:37.881+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:37.954 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:37.951+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:38.870 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:38.867+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:38.965 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:38.962+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:39.866 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:39.863+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:39.939 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:39.936+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:40.886 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:40.883+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:40.960 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:40.957+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:41.874 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:41.871+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:41.976 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:41.973+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:42.828 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:42.825+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:42.998 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:42.995+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:43.788 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:43.785+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:43.995 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:43.992+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:44.816 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:44.813+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:44.965 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:44.962+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:45.835 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:45.832+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:46.009 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:46.006+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:46.802 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:46.799+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:46.979 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:46.976+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:47.812 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:47.809+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:48.024 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:48.021+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:48.840 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:48.837+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:49.066 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:49.063+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:49.856 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:49.853+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:50.086 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:50.083+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:50.808 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:50.805+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:51.072 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:51.069+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:51.784 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:51.781+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:52.032 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:52.029+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:52.774 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:52.771+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:53.018 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:53.015+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:53.806 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:53.803+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:54.025 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:54.021+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:54.799 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:54.795+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:55.039 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:55.035+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:55.812 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:55.808+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:56.028 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:56.024+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:56.925 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:56.849+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:57.042 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:57.038+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:57.898 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:57.894+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:58.025 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:58.021+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:58.876 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:58.872+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:01:59.034 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:01:59.030+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:01:59.894 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:01:59.890+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:00.044 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:00.040+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:00.904 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:00.900+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:01.032 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:01.028+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:01.896 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:01.892+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:02.037 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:02.033+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:02.876 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:02.872+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:03.047 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:03.044+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:03.906 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:03.903+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:04.000 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:03.997+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:04.899 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:04.895+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:05.023 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:05.020+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:05.854 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:05.851+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:06.001 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:05.998+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:06.831 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:06.828+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:07.001 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:06.998+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:07.785 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:07.782+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:08.025 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:08.022+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:08.755 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:08.752+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:09.031 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:09.027+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:09.760 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:09.757+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:10.045 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:10.042+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:10.753 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:10.750+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:11.086 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:11.083+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:11.763 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:11.760+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:12.113 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:12.110+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:12.780 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:12.777+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:13.129 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:13.126+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:13.817 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:13.814+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:14.155 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:14.152+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:14.841 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:14.838+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:15.131 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:15.128+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:15.873 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:15.870+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:16.137 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:16.134+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:16.921 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:16.918+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:17.166 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:17.163+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:17.941 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:17.938+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:18.186 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:18.183+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:18.895 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:18.891+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:19.151 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:19.148+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:19.928 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:19.925+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:20.185 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:20.182+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:20.915 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:20.912+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:21.235 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:21.232+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:21.913 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:21.910+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:22.285 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:22.282+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:22.886 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:22.883+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:23.288 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:23.285+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:23.843 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:23.840+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:24.293 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:24.290+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:24.861 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:24.858+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:25.269 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:25.264+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:25.875 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:25.867+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:26.311 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:26.308+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:26.883 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:26.879+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:27.277 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:27.268+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:27.925 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:27.921+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:28.310 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:28.307+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:28.935 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:28.932+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:29.275 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:29.272+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:29.965 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:29.962+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:30.248 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:30.245+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:30.962 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:30.959+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:31.238 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:31.235+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:31.957 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:31.954+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:32.229 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:32.225+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:33.004 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:33.001+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:33.275 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:33.272+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:34.036 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:34.032+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:34.276 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:34.273+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:35.052 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:35.049+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:35.244 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:35.241+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:36.008 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:36.005+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:36.234 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:36.231+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:37.021 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:37.017+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:37.282 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:37.278+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:37.973 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:37.969+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:38.317 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:38.313+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:39.002 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:38.998+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:39.271 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:39.267+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:39.982 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:39.978+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:40.276 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:40.271+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:41.002 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:40.998+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:41.281 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:41.277+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:42.001 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:41.997+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:42.290 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:42.286+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:42.960 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:42.956+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:43.263 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:43.259+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:43.995 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:43.991+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:44.239 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:44.235+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:45.034 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:45.030+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:45.210 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:45.207+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:46.073 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:46.070+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:46.191 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:46.188+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:47.030 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:47.027+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:47.236 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:47.233+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:48.016 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:48.013+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:48.278 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:48.275+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:49.011 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:49.008+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:49.303 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:49.299+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:49.990 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:49.987+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:50.345 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:50.342+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:50.963 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:50.960+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:51.380 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:51.377+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:52.009 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:52.006+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:52.354 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:52.351+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:53.048 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:53.044+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:53.345 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:53.342+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:54.089 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:54.085+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:54.339 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:54.299+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:55.115 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:55.112+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:55.321 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:55.318+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:56.078 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:56.075+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:56.357 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:56.354+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:57.110 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:57.107+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:57.393 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:57.390+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:58.149 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:58.146+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:58.358 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:58.355+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:02:59.195 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:02:59.192+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:02:59.388 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:02:59.384+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:00.175 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:00.172+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:00.413 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:00.410+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:01.209 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:01.206+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:01.424 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:01.421+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:02.228 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:02.225+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:02.403 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:02.400+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:03.275 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:03.272+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:03.439 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:03.436+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:04.253 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:04.250+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:04.462 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:04.459+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:05.208 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:05.205+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:05.483 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:05.480+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:06.190 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:06.187+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:06.517 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:06.514+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:07.187 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:07.184+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:07.525 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:07.522+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:08.180 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:08.177+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:08.480 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:08.477+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:09.224 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:09.221+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:09.504 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:09.500+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:10.188 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:10.185+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:10.460 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:10.457+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:11.220 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:11.217+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:11.503 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:11.500+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:12.253 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:12.250+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:12.487 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:12.484+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:13.232 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:13.229+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:13.522 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:13.519+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:14.269 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:14.266+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:14.542 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:14.539+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:15.237 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:15.234+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:15.512 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:15.509+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:16.269 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:16.266+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:16.469 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:16.465+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:17.257 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:17.254+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:17.429 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:17.426+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:18.281 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:18.278+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:18.416 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:18.413+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:19.249 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:19.245+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:19.409 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:19.405+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:20.288 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:20.284+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:20.387 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:20.383+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:21.300 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:21.296+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:21.350 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:21.346+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:22.307 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:22.303+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:22.332 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:22.328+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:23.357 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:23.353+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:23.370 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:23.366+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:24.347 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:24.343+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:24.417 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:24.413+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:25.345 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:25.340+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:25.380 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:25.376+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:26.337 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:26.333+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:26.388 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:26.384+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:27.365 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:27.361+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:27.407 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:27.403+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:28.331 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:28.326+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:28.380 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:28.376+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:29.300 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:29.293+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:29.365 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:29.362+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:30.274 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:30.268+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:30.317 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:30.314+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:31.243 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:31.240+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:31.357 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:31.354+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:32.267 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:32.264+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:32.405 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:32.402+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:33.283 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:33.280+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:33.398 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:33.395+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:34.310 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:34.307+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:34.374 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:34.371+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:35.299 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:35.296+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:35.378 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:35.375+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:36.311 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:36.308+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:36.332 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:36.329+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:37.269 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:37.266+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:37.296 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:37.293+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:38.231 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:38.228+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:38.333 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:38.330+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:39.221 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:39.218+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:39.345 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:39.342+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:40.267 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:40.264+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:40.390 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:40.386+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:41.264 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:41.261+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:41.351 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:41.348+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:42.232 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:42.229+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:42.364 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:42.361+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:43.255 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:43.252+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:43.317 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:43.314+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:44.232 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:44.229+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:44.285 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:44.282+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:45.272 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:45.269+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:45.329 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:45.326+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:46.224 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:46.220+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:46.335 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:46.332+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:47.185 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:47.182+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:47.286 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:47.283+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:48.159 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:48.156+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:48.311 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:48.308+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:49.172 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:49.169+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:49.325 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:49.322+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:50.148 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:50.145+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:50.315 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:50.312+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:51.133 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:51.130+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:51.273 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:51.270+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:52.166 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:52.163+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:52.230 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:52.227+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:53.150 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:53.147+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:53.232 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:53.229+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:54.186 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:54.183+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:54.191 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:54.188+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:55.207 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:55.204+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:55.676 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:55.214+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:56.164 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:56.161+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:56.241 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:56.238+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:57.185 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:57.181+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:57.284 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:57.281+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:58.199 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:58.196+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:03:58.248 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:58.245+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:59.211 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:03:59.208+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:03:59.227 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:03:59.224+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:00.199 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:00.196+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:00.213 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:00.210+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:01.229 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:01.226+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:01.261 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:01.258+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:02.217 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:02.212+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:02.282 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:02.278+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:03.258 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:03.254+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:03.309 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:03.305+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:04.256 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:04.252+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:04.348 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:04.344+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:05.255 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:05.251+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:05.308 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:05.304+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:06.285 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:06.281+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:06.287 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:06.283+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:07.297 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:07.292+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:07.322 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:07.318+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:08.331 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:08.326+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:08.358 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:08.354+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:09.363 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:09.359+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:09.376 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:09.372+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:10.353 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:10.350+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:10.364 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:10.360+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:11.306 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:11.303+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:11.340 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:11.337+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:12.270 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:12.266+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:12.299 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:12.296+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:13.260 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:13.257+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:13.332 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:13.329+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:14.258 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:14.255+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:14.313 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:14.310+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:15.263 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:15.260+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:15.314 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:15.311+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:16.302 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:16.299+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:16.339 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:16.336+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:17.332 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:17.329+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:17.335 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:17.333+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:18.302 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:18.299+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:18.374 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:18.371+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:19.304 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:19.301+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:19.370 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:19.367+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:20.297 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:20.294+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:20.405 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:20.402+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:21.328 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:21.325+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:21.372 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:21.369+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:22.333 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:22.330+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:22.337 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:22.334+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:23.334 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:23.331+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:23.377 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:23.374+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:24.338 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:24.334+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:24.383 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:24.379+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:25.304 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:25.301+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:25.386 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:25.383+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:26.306 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:26.303+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:26.386 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:26.383+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:27.320 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:27.317+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:27.412 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:27.409+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:28.364 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:28.360+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:28.461 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:28.458+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:29.322 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:29.319+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:29.414 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:29.411+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:30.352 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:30.349+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:30.430 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:30.427+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:31.335 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:31.332+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:31.449 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:31.446+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:32.313 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:32.310+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:32.478 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:32.475+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:33.296 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:33.293+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:33.488 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:33.485+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:34.315 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:34.312+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:34.516 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:34.512+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:35.357 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:35.354+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:35.482 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:35.478+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:36.358 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:36.355+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:36.528 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:36.525+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:37.362 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:37.359+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:37.571 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:37.568+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:38.373 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:38.370+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:38.579 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:38.576+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:39.357 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:39.353+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:39.542 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:39.539+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:40.362 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:40.359+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:40.510 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:40.507+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:41.385 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:41.381+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:41.466 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:41.463+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:42.346 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:42.343+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:42.419 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:42.416+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:43.298 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:43.295+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:43.415 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:43.412+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:44.320 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:44.316+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:44.458 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:44.454+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:45.309 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:45.305+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:45.503 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:45.499+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:46.272 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:46.268+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:46.459 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:46.455+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:47.225 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:47.221+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:47.445 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:47.441+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:48.245 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:48.241+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:48.439 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:48.435+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:49.255 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:49.251+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:49.476 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:49.472+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:50.253 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:50.249+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:50.487 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:50.483+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:51.269 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:51.265+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:51.490 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:51.485+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:52.264 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:52.260+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:52.477 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:52.473+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:53.273 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:53.269+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:53.436 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:53.433+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:54.279 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:54.276+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:54.441 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:54.438+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:55.240 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:55.236+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:55.423 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:55.420+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:56.257 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:56.254+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:56.473 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:56.470+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:57.307 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:57.304+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:57.463 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:57.460+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:58.337 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:58.334+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:58.472 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:58.468+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:04:59.305 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:04:59.302+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:04:59.439 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:04:59.436+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:00.312 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:00.309+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:00.473 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:00.470+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:01.317 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:01.314+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:01.503 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:01.500+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:02.362 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:02.359+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:02.477 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:02.474+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:03.324 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:03.321+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:03.507 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:03.503+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:04.338 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:04.334+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:04.479 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:04.476+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:05.355 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:05.352+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:05.497 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:05.494+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:06.309 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:06.305+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:06.492 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:06.489+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:07.263 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:07.260+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:07.536 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:07.533+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:08.276 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:08.272+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:08.585 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:08.582+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:09.277 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:09.274+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:09.605 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:09.602+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:10.230 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:10.227+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:10.615 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:10.612+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:11.192 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:11.189+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:11.619 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:11.616+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:12.204 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:12.201+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:12.619 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:12.616+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:13.178 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:13.175+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:13.656 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:13.653+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:14.209 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:14.206+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:14.702 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:14.699+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:15.195 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:15.192+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:15.655 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:15.652+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:16.183 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:16.180+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:16.677 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:16.674+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:17.232 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:17.228+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:17.721 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:17.717+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:18.226 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:18.223+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:18.758 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:18.755+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:19.226 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:19.222+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:19.794 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:19.791+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:20.193 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:20.190+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:20.771 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:20.768+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:21.233 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:21.230+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:21.755 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:21.752+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:22.199 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:22.196+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:22.758 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:22.755+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:23.161 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:23.158+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:23.748 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:23.744+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:24.142 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:24.139+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:24.791 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:24.788+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:25.140 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:25.137+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:25.764 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:25.761+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:26.101 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:26.098+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:26.800 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:26.796+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:27.112 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:27.108+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:27.773 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:27.769+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:28.130 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:28.126+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:28.765 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:28.761+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:29.177 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:29.173+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:29.725 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:29.721+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:30.203 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:30.199+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:30.775 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:30.771+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:31.171 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:31.167+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:31.794 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:31.790+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:32.154 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:32.150+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:32.808 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:32.804+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:33.195 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:33.191+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:33.799 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:33.795+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:34.228 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:34.224+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:34.767 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:34.763+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:35.224 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:35.220+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:35.783 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:35.780+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:36.175 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:36.172+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:36.735 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:36.732+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:37.173 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:37.170+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:37.741 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:37.738+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:38.204 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:38.201+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:38.780 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:38.777+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:39.183 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:39.180+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:39.799 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:39.795+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:40.231 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:40.227+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:40.805 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:40.802+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:41.278 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:41.275+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:41.792 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:41.789+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:42.323 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:42.319+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:42.790 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:42.787+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:43.285 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:43.281+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:43.823 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:43.819+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:44.265 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:44.262+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:44.817 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:44.813+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:45.247 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:45.244+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:45.786 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:45.783+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:46.212 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:46.209+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:46.761 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:46.758+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:47.241 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:47.238+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:47.721 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:47.718+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:48.198 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:48.195+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:48.768 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:48.765+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:49.192 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:49.189+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:49.815 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:49.811+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:50.176 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:50.173+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:50.813 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:50.810+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:51.207 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:51.204+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:51.846 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:51.843+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:52.160 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:52.156+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:52.817 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:52.814+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:53.164 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:53.161+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:53.850 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:53.847+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:54.156 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:54.153+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:54.818 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:54.815+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:55.147 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:55.144+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:55.789 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:55.785+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:56.129 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:56.126+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:56.809 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:56.805+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:57.177 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:57.174+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:57.771 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:57.768+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:58.194 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:58.191+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:58.739 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:58.736+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:05:59.209 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:05:59.206+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:05:59.779 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:05:59.776+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:00.186 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:00.183+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:00.787 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:00.784+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:01.146 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:01.143+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:01.773 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:01.770+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:02.135 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:02.132+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:02.784 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:02.781+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:03.104 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:03.101+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:03.787 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:03.784+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:04.138 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:04.135+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:04.805 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:04.802+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:05.101 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:05.098+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:05.827 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:05.823+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:06.125 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:06.122+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:06.877 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:06.874+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:07.091 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:07.088+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:07.883 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:07.880+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:08.131 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:08.128+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:08.921 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:08.917+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:09.096 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:09.093+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:09.948 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:09.944+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:10.084 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:10.080+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:10.957 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:10.953+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:11.049 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:11.045+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:11.921 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:11.917+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:12.026 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:12.022+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:12.927 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:12.923+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:13.001 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:12.997+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:13.971 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:13.967+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:14.047 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:14.043+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:14.943 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:14.939+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:15.027 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:15.023+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:15.991 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:15.987+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:16.013 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:16.009+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:16.990 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:16.986+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:17.032 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:17.028+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:18.004 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:18.000+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:18.040 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:18.036+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:18.999 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:18.996+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:19.033 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:19.029+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:20.042 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:20.038+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:20.072 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:20.069+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:21.034 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:21.031+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:21.063 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:21.060+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:22.055 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:22.052+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:22.074 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:22.071+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:23.010 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:23.006+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:23.063 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:23.060+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:24.045 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:24.042+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:24.074 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:24.071+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:25.054 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:25.051+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:25.085 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:25.082+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:26.015 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:26.012+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:26.060 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:26.057+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:27.013 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:27.010+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:27.085 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:27.081+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:28.023 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:28.019+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:28.098 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:28.095+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:29.013 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:29.010+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:29.139 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:29.136+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:30.036 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:30.032+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:30.187 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:30.184+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:31.013 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:31.010+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:31.215 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:31.212+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:32.037 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:32.034+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:32.244 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:32.240+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:33.061 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:33.058+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:33.269 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:33.265+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:34.050 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:34.046+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:34.259 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:34.256+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:35.081 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:35.078+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:35.281 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:35.277+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:36.089 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:36.086+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:36.304 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:36.301+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:37.104 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:37.100+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:37.311 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:37.308+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:38.059 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:38.055+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:38.287 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:38.284+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:39.047 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:39.044+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:39.242 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:39.239+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:40.048 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:40.045+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:40.239 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:40.235+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:41.087 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:41.084+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:41.248 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:41.245+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:42.073 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:42.069+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:42.277 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:42.274+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:43.113 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:43.110+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:43.313 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:43.309+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:44.123 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:44.120+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:44.313 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:44.310+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:45.083 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:45.080+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:45.269 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:45.266+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:46.115 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:46.112+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:46.249 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:46.246+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:47.095 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:47.092+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:47.261 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:47.258+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:48.115 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:48.112+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:48.219 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:48.216+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:49.079 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:49.076+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:49.207 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:49.204+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:50.106 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:50.102+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:50.234 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:50.231+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:51.139 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:51.136+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:51.252 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:51.249+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:52.184 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:52.180+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:52.277 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:52.273+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:53.191 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:53.187+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:53.241 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:53.236+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:54.218 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:54.214+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:54.224 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:54.220+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:55.212 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:55.207+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:55.272 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:55.268+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:56.210 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:56.206+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:56.244 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:56.240+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:57.261 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:57.257+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:57.262 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:57.258+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:58.225 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:58.220+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:58.265 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:58.261+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:06:59.263 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:06:59.259+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:06:59.303 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:06:59.299+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:00.244 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:00.240+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:00.313 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:00.310+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:01.214 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:01.211+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:01.300 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:01.297+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:02.214 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:02.211+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:02.289 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:02.286+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:03.219 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:03.216+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:03.249 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:03.246+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:04.174 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:04.171+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:04.284 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:04.281+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:05.170 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:05.166+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:05.321 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:05.318+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:06.159 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:06.156+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:06.284 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:06.281+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:07.196 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:07.193+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:07.297 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:07.294+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:08.178 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:08.175+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:08.337 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:08.334+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:09.171 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:09.168+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:09.354 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:09.351+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:10.141 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:10.138+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:10.364 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:10.361+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:11.115 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:11.112+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:11.316 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:11.313+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:12.079 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:12.076+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:12.339 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:12.336+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:13.110 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:13.107+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:13.358 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:13.355+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:14.138 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:14.135+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:14.346 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:14.343+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:15.093 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:15.089+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:15.330 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:15.327+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:16.056 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:16.053+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:16.350 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:16.347+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:17.084 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:17.081+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:17.400 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:17.397+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:18.044 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:18.041+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:18.386 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:18.383+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:19.027 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:19.024+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:19.429 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:19.426+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:20.054 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:20.051+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:20.386 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:20.383+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:21.095 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:21.092+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:21.432 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:21.429+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:22.095 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:22.092+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:22.425 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:22.422+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:23.048 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:23.044+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:23.382 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:23.379+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:24.057 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:24.053+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:24.409 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:24.406+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:25.044 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:25.041+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:25.393 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:25.390+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:26.076 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:26.072+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:26.356 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:26.353+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:27.088 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:27.084+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:27.373 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:27.370+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:28.108 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:28.105+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:28.415 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:28.412+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:29.120 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:29.117+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:29.430 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:29.427+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:30.074 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:30.071+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:30.406 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:30.403+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:31.107 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:31.104+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:31.422 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:31.418+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:32.141 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:32.138+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:32.381 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:32.378+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:33.162 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:33.159+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:33.375 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:33.372+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:34.197 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:34.194+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:34.417 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:34.413+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:35.197 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:35.193+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:35.444 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:35.440+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:36.154 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:36.150+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:36.473 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:36.468+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:37.154 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:37.150+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:37.520 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:37.516+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:38.196 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:38.192+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:38.515 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:38.511+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:39.194 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:39.189+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:39.545 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:39.541+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:40.230 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:40.226+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:40.530 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:40.526+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:41.211 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:41.207+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:41.568 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:41.564+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:42.195 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:42.191+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:42.558 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:42.554+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:43.192 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:43.188+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:43.592 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:43.589+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:44.214 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:44.211+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:44.599 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:44.595+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:45.234 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:45.231+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:45.645 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:45.641+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:46.225 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:46.222+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:46.688 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:46.685+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:47.195 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:47.192+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:47.707 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:47.704+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:48.161 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:48.158+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:48.726 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:48.722+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:49.197 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:49.194+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:49.731 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:49.728+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:50.174 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:50.171+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:50.777 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:50.774+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:51.126 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:51.123+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:51.761 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:51.758+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:52.094 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:52.091+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:52.747 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:52.744+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:53.082 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:53.078+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:53.781 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:53.778+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:54.102 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:54.099+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:54.800 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:54.797+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:55.055 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:55.052+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:55.813 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:55.810+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:56.076 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:56.072+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:56.805 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:56.802+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:57.113 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:57.110+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:57.787 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:57.783+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:58.089 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:58.085+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:58.769 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:58.766+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:07:59.107 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:07:59.104+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:07:59.801 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:07:59.798+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:00.093 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:00.090+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:00.822 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:00.819+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:01.079 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:01.076+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:01.778 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:01.775+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:02.102 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:02.099+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:02.748 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:02.745+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:03.094 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:03.091+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:03.749 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:03.746+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:04.093 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:04.090+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:04.755 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:04.752+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:05.090 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:05.087+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:05.781 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:05.778+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:06.071 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:06.068+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:06.738 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:06.734+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:07.121 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:07.116+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:07.704 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:07.700+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:08.123 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:08.120+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:08.655 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:08.652+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:09.170 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:09.167+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:09.637 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:09.634+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:10.129 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:10.126+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:10.663 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:10.658+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:11.087 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:11.084+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:11.674 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:11.671+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:12.134 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:12.131+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:12.637 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:12.634+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:13.090 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:13.087+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:13.677 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:13.673+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:14.131 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:14.128+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:14.665 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:14.661+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:15.148 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:15.144+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:15.679 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:15.676+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:16.185 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:16.182+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:16.717 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:16.713+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:17.166 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:17.162+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:17.726 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:17.722+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:18.143 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:18.139+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:18.729 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:18.724+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:19.098 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:19.094+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:19.682 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:19.678+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:20.114 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:20.109+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:20.729 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:20.725+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:21.139 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:21.135+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:21.757 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:21.753+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:22.181 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:22.177+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:22.739 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:22.734+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:23.192 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:23.189+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:23.714 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:23.710+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:24.166 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:24.163+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:24.756 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:24.752+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:25.184 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:25.180+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:25.768 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:25.765+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:26.199 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:26.196+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:26.735 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:26.732+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:27.230 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:27.227+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:27.769 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:27.766+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:28.242 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:28.236+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:28.771 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:28.768+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:29.221 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:29.218+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:29.771 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:29.767+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:30.235 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:30.232+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:30.766 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:30.763+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:31.241 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:31.238+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:31.736 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:31.733+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:32.228 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:32.225+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:32.715 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:32.711+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:33.249 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:33.246+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:33.669 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:33.666+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:34.263 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:34.260+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:34.720 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:34.716+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:35.286 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:35.283+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:35.721 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:35.718+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:36.285 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:36.282+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:36.706 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:36.702+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:37.236 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:37.233+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:37.713 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:37.710+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:38.226 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:38.223+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:38.668 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:38.665+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:39.186 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:39.183+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:39.643 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:39.640+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:40.201 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:40.198+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:40.625 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:40.622+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:41.214 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:41.211+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:41.638 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:41.634+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:42.193 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:42.189+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:42.632 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:42.628+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:43.219 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:43.216+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:43.595 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:43.592+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:44.187 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:44.184+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:44.595 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:44.592+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:45.203 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:45.200+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:45.555 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:45.552+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:46.191 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:46.188+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:46.544 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:46.540+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:47.237 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:47.234+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:47.552 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:47.549+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:48.205 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:48.202+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:48.525 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:48.521+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:49.185 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:49.182+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:49.514 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:49.511+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:50.208 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:50.205+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:50.504 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:50.501+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:51.191 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:51.188+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:51.508 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:51.505+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:52.178 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:52.175+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:52.498 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:52.495+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:53.210 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:53.207+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:53.483 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:53.480+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:54.235 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:54.231+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:54.474 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:54.471+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:55.239 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:55.236+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:55.522 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:55.518+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:56.263 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:56.259+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:56.530 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:56.527+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:57.233 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:57.229+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:57.543 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:57.539+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:58.278 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:58.275+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:58.531 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:58.528+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:08:59.265 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:08:59.262+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:08:59.555 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:08:59.551+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:00.249 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:00.245+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:00.529 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:00.525+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:01.245 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:01.238+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:01.570 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:01.565+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:02.215 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:02.210+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:02.535 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:02.531+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:03.209 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:03.205+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:03.515 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:03.511+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:04.254 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:04.250+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:04.491 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:04.487+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:05.295 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:05.291+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:05.533 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:05.529+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:06.259 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:06.255+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:06.545 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:06.541+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:07.249 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:07.245+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:07.505 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:07.501+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:08.232 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:08.229+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:08.506 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:08.502+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:09.270 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:09.267+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:09.488 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:09.484+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:10.252 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:10.249+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:10.452 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:10.449+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:11.303 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:11.300+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:11.497 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:11.493+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:12.315 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:12.312+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:12.466 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:12.463+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:13.282 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:13.279+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:13.484 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:13.481+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:14.320 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:14.317+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:14.512 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:14.509+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:15.285 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:15.281+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:15.490 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:15.487+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:16.313 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:16.309+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:16.523 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:16.519+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:17.309 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:17.306+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:17.488 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:17.485+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:18.340 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:18.337+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:18.469 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:18.466+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:19.343 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:19.339+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:19.472 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:19.469+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:20.294 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:20.291+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:20.507 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:20.504+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:21.341 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:21.338+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:21.545 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:21.542+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:22.297 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:22.294+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:22.498 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:22.495+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:23.249 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:23.246+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:23.536 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:23.533+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:24.225 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:24.222+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:24.539 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:24.535+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:25.267 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:25.264+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:25.512 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:25.508+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:26.257 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:26.254+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:26.510 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:26.507+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:27.255 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:27.252+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:27.547 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:27.544+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:28.299 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:28.296+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:28.568 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:28.565+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:29.286 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:29.283+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:29.574 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:29.571+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:30.264 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:30.261+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:30.566 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:30.563+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:31.242 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:31.239+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:31.604 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:31.601+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:32.270 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:32.267+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:32.601 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:32.598+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:33.258 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:33.254+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:33.600 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:33.597+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:34.265 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:34.262+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:34.604 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:34.601+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:35.242 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:35.238+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:35.601 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:35.598+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:36.270 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:36.267+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:36.620 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:36.617+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:37.290 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:37.287+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:37.649 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:37.646+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:38.250 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:38.247+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:38.641 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:38.638+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:39.234 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:39.231+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:39.617 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:39.613+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:40.255 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:40.252+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:40.618 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:40.615+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:41.255 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:41.252+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:41.652 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:41.649+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:42.207 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:42.202+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:42.623 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:42.619+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:43.213 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:43.209+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:43.585 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:43.581+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:44.218 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:44.214+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:44.630 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:44.626+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:45.200 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:45.196+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:45.593 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:45.589+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:46.153 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:46.149+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:46.594 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:46.590+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:47.104 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:47.100+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:47.606 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:47.602+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:48.110 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:48.106+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:48.634 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:48.629+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:49.120 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:49.116+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:49.643 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:49.638+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:50.076 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:50.072+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:50.620 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:50.616+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:51.091 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:51.087+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:51.646 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:51.643+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:52.094 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:52.091+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:52.666 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:52.663+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:53.104 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:53.101+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:53.640 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:53.637+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:54.065 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:54.062+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:54.674 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:54.671+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:55.112 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:55.109+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:55.656 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:55.653+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:56.156 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:56.153+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:56.685 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:56.682+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:57.131 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:57.128+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:57.722 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:57.719+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:58.181 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:58.177+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:58.711 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:58.707+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:09:59.210 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:09:59.207+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:09:59.678 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:09:59.675+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:00.204 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:00.201+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:00.701 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:00.698+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:01.212 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:01.209+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:01.749 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:01.745+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:02.196 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:02.193+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:02.781 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:02.778+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:03.166 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:03.163+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:03.771 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:03.768+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:04.208 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:04.204+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:04.792 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:04.789+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:05.225 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:05.222+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:05.832 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:05.829+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:06.189 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:06.186+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:06.870 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:06.867+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:07.208 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:07.205+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:07.855 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:07.852+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:08.253 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:08.250+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:08.812 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:08.808+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:09.293 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:09.290+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:09.769 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:09.766+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:10.314 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:10.311+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:10.742 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:10.739+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:11.287 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:11.284+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:11.760 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:11.757+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:12.329 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:12.326+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:12.761 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:12.758+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:13.322 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:13.319+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:13.809 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:13.806+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:14.352 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:14.349+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:14.780 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:14.777+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:15.372 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:15.369+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:15.778 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:15.775+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:16.423 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:16.420+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:16.745 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:16.742+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:17.448 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:17.445+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:17.795 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:17.792+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:18.431 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:18.428+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:18.754 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:18.751+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:19.454 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:19.451+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:19.790 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:19.787+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:20.428 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:20.425+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:20.806 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:20.803+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:21.396 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:21.393+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:21.824 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:21.820+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:22.374 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:22.371+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:22.854 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:22.851+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:23.403 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:23.400+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:23.900 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:23.897+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:24.400 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:24.397+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:24.894 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:24.890+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:25.408 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:25.404+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:25.877 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:25.872+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:26.424 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:26.420+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:26.857 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:26.853+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:27.400 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:27.395+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:27.894 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:27.890+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:28.403 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:28.399+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:28.894 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:28.890+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:29.381 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:29.377+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:29.924 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:29.919+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:30.396 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:30.392+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:30.970 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:30.966+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:31.389 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:31.385+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:31.927 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:31.923+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:32.367 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:32.363+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:32.893 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:32.889+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:33.393 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:33.390+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:33.921 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:33.917+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:34.357 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:34.354+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:34.943 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:34.940+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:35.377 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:35.373+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:35.981 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:35.978+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:36.403 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:36.399+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:36.937 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:36.934+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:37.374 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:37.371+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:37.919 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:37.916+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:38.377 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:38.373+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:38.966 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:38.962+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:39.379 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:39.376+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:39.972 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:39.968+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:40.415 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:40.412+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:40.947 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:40.944+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:41.454 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:41.451+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:41.933 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:41.930+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:42.443 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:42.439+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:42.915 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:42.912+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:43.397 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:43.393+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:43.963 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:43.959+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:44.381 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:44.378+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:44.953 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:44.950+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:45.341 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:45.338+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:45.959 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:45.955+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:46.339 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:46.336+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:46.991 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:46.987+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:47.346 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:47.343+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:47.950 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:47.947+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:48.321 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:48.318+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:48.942 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:48.939+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:49.368 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:49.365+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:49.957 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:49.953+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:50.362 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:50.359+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:50.945 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:50.941+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:51.382 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:51.379+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:51.909 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:51.906+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:52.370 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:52.367+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:52.875 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:52.872+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:53.383 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:53.379+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:53.869 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:53.866+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:54.347 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:54.344+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:54.824 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:54.821+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:55.337 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:55.334+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:55.846 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:55.843+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:56.334 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:56.331+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:56.879 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:56.876+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:57.333 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:57.330+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:57.839 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:57.836+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:58.313 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:58.309+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:58.816 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:58.813+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:10:59.325 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:10:59.321+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:10:59.811 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:10:59.808+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:00.333 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:00.330+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:00.767 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:00.764+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:01.331 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:01.328+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:01.762 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:01.759+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:02.333 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:02.329+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:02.773 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:02.770+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:03.332 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:03.329+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:03.790 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:03.786+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:04.295 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:04.292+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:04.773 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:04.770+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:05.283 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:05.280+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:05.817 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:05.814+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:06.283 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:06.279+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:06.828 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:06.825+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:07.283 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:07.279+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:07.802 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:07.797+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:08.297 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:08.293+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:08.757 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:08.752+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:09.306 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:09.302+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:09.742 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:09.738+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:10.347 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:10.342+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:10.713 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:10.709+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:11.373 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:11.369+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:11.681 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:11.677+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:12.356 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:12.352+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:12.703 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:12.699+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:13.354 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:13.350+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:13.752 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:13.747+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:14.349 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:14.345+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:14.796 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:14.792+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:15.376 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:15.372+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:15.826 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:15.821+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:16.390 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:16.386+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:16.852 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:16.849+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:17.438 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:17.435+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:17.860 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:17.857+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:18.435 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:18.432+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:18.824 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:18.820+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:19.393 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:19.389+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:19.845 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:19.842+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:20.390 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:20.387+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:20.811 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:20.808+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:21.383 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:21.380+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:21.777 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:21.774+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:22.373 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:22.370+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:22.786 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:22.783+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:23.403 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:23.400+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:23.779 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:23.776+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:24.448 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:24.445+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:24.773 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:24.770+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:25.429 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:25.426+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:25.764 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:25.760+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:26.428 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:26.425+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:26.751 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:26.747+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:27.403 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:27.400+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:27.728 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:27.725+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:28.426 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:28.423+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:28.743 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:28.739+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:29.434 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:29.430+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:29.755 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:29.752+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:30.471 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:30.468+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:30.751 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:30.748+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:31.519 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:31.516+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:31.732 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:31.729+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:32.564 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:32.560+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:32.778 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:32.775+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:33.611 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:33.608+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:33.791 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:33.788+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:34.594 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:34.591+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:34.776 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:34.773+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:35.569 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:35.566+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:35.814 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:35.810+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:36.553 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:36.550+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:36.845 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:36.842+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:37.585 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:37.582+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:37.828 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:37.825+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:38.596 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:38.593+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:38.782 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:38.779+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:39.618 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:39.615+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:39.816 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:39.812+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:40.667 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:40.664+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:40.819 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:40.816+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:41.646 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:41.642+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:41.858 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:41.855+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:42.615 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:42.612+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:42.823 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:42.820+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:43.636 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:43.633+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:43.847 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:43.843+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:44.654 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:44.651+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:44.810 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:44.807+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:45.669 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:45.666+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:45.840 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:45.837+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:46.648 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:46.645+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:46.885 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:46.882+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:47.642 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:47.639+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:47.925 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:47.921+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:48.690 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:48.687+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:48.875 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:48.872+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:49.695 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:49.692+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:49.883 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:49.879+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:50.670 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:50.666+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:50.905 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:50.901+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:51.630 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:51.625+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:51.942 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:51.937+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:52.610 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:52.606+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:52.954 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:52.950+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:53.623 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:53.619+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:53.934 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:53.930+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:54.615 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:54.611+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:54.911 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:54.907+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:55.642 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:55.638+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:55.905 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:55.901+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:56.643 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:56.639+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:56.937 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:56.933+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:57.601 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:57.596+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:57.905 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:57.900+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:58.576 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:58.572+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:58.909 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:58.905+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:11:59.540 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:11:59.537+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:11:59.873 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:11:59.870+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:00.500 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:00.497+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:00.888 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:00.885+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:01.482 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:01.479+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:01.938 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:01.935+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:02.456 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:02.453+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:02.938 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:02.935+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:03.501 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:03.497+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:03.946 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:03.943+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:04.507 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:04.503+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:04.958 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:04.955+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:05.486 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:05.483+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:05.972 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:05.969+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:06.464 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:06.461+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:07.021 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:07.017+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:07.498 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:07.495+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:08.016 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:08.013+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:08.494 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:08.490+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:09.064 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:09.061+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:09.494 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:09.491+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:10.028 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:10.025+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:10.496 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:10.492+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:11.060 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:11.057+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:11.520 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:11.517+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:12.026 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:12.023+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:12.486 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:12.483+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:13.029 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:13.026+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:13.439 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:13.436+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:13.997 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:13.994+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:14.413 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:14.410+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:14.987 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:14.984+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:15.434 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:15.431+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:16.000 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:15.997+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:16.479 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:16.475+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:17.028 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:17.025+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:17.454 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:17.451+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:18.033 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:18.030+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:18.503 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:18.499+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:19.061 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:19.058+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:19.459 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:19.456+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:20.089 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:20.085+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:20.486 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:20.483+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:21.090 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:21.087+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:21.504 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:21.501+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:22.089 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:22.086+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:22.531 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:22.528+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:23.086 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:23.083+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:23.578 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:23.575+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:24.041 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:24.038+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:24.616 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:24.612+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:25.069 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:25.065+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:25.627 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:25.623+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:26.038 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:26.034+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:26.587 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:26.584+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:27.049 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:27.045+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:27.572 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:27.569+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:28.057 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:28.053+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:28.582 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:28.578+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:29.017 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:29.014+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:29.544 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:29.541+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:30.049 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:30.046+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:30.526 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:30.523+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:31.024 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:31.020+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:31.525 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:31.521+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:31.988 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:31.985+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:32.536 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:32.531+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:33.017 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:33.013+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:33.580 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:33.576+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:34.053 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:34.049+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:34.567 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:34.563+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:35.021 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:35.017+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:35.544 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:35.539+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:36.043 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:36.039+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:36.551 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:36.547+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:37.092 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:37.088+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:37.508 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:37.504+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:38.069 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:38.065+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:38.543 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:38.540+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:39.052 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:39.048+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:39.558 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:39.554+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:40.036 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:40.032+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:40.577 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:40.573+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:40.991 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:40.987+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:41.587 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:41.583+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:42.027 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:42.023+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:42.554 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:42.550+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:43.008 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:43.005+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:43.524 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:43.521+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:44.058 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:44.055+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:44.539 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:44.536+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:45.066 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:45.063+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:45.538 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:45.534+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:46.028 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:46.025+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:46.496 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:46.493+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:46.998 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:46.995+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:47.532 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:47.529+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:48.020 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:48.017+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:48.491 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:48.488+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:49.002 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:48.998+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:49.508 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:49.505+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:49.983 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:49.980+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:50.511 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:50.508+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:50.970 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:50.967+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:51.531 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:51.528+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:51.928 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:51.924+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:52.563 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:52.560+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:52.880 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:52.877+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:53.588 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:53.585+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:53.912 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:53.909+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:54.611 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:54.608+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:54.926 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:54.922+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:55.608 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:55.605+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:55.954 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:55.951+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:56.568 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:56.565+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:56.912 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:56.908+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:57.548 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:57.545+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:57.886 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:57.883+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:58.566 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:58.563+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:58.860 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:58.856+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:12:59.551 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:12:59.548+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:12:59.825 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:12:59.821+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:00.547 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:00.544+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:00.873 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:00.870+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:01.573 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:01.569+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:01.837 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:01.833+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:02.556 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:02.553+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:02.838 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:02.834+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:03.558 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:03.554+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:03.839 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:03.836+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:04.578 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:04.574+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:04.866 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:04.863+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:05.621 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:05.618+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:05.875 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:05.871+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:06.626 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:06.622+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:06.878 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:06.875+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:07.670 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:07.667+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:07.838 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:07.835+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:08.665 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:08.662+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:08.813 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:08.809+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:09.694 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:09.691+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:09.820 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:09.817+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:10.700 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:10.696+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:10.850 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:10.847+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:11.710 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:11.707+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:11.886 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:11.883+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:12.716 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:12.712+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:12.882 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:12.879+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:13.722 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:13.719+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:13.877 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:13.873+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:14.693 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:14.690+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:14.916 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:14.912+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:15.670 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:15.666+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:15.958 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:15.953+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:16.694 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:16.689+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:16.926 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:16.921+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:17.738 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:17.734+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:17.892 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:17.888+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:18.766 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:18.761+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:18.884 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:18.880+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:19.763 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:19.759+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:19.863 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:19.859+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:20.735 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:20.730+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:20.871 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:20.867+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:21.782 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:21.778+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:21.897 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:21.893+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:22.734 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:22.730+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:22.937 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:22.932+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:23.710 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:23.706+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:23.955 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:23.951+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:24.745 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:24.740+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:24.958 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:24.955+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:25.782 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:25.779+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:25.960 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:25.956+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:26.766 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:26.763+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:26.987 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:26.983+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:27.767 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:27.764+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:27.947 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:27.944+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:28.791 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:28.788+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:28.947 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:28.944+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:29.760 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:29.757+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:29.917 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:29.914+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:30.808 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:30.804+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:30.899 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:30.896+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:31.843 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:31.840+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:31.863 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:31.860+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:32.796 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:32.792+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:32.829 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:32.826+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:33.753 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:33.750+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:33.803 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:33.800+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:34.755 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:34.752+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:34.796 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:34.792+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:35.733 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:35.730+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:35.834 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:35.831+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:36.743 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:36.740+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:36.874 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:36.871+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:37.767 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:37.763+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:37.867 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:37.864+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:38.807 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:38.804+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:38.823 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:38.820+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:39.780 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:39.777+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:39.840 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:39.836+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:40.753 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:40.750+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:40.877 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:40.874+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:41.743 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:41.740+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:41.912 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:41.908+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:42.723 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:42.720+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:42.959 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:42.956+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:43.679 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:43.675+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:43.932 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:43.928+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:44.670 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:44.666+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:44.883 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:44.879+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:45.624 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:45.621+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:45.866 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:45.863+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:46.666 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:46.663+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:46.837 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:46.834+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:47.636 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:47.633+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:47.844 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:47.841+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:48.602 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:48.598+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:48.800 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:48.796+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:49.641 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:49.637+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:49.835 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:49.832+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:50.683 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:50.680+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:50.828 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:50.825+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:51.721 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:51.718+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:51.855 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:51.851+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:52.733 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:52.730+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:52.808 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:52.804+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:53.691 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:53.688+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:53.821 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:53.818+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:54.678 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:54.675+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:54.837 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:54.834+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:55.721 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:55.718+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:55.848 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:55.844+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:56.705 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:56.702+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:56.802 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:56.799+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:57.678 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:57.675+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:57.765 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:57.761+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:58.636 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:58.632+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:58.724 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:58.720+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:13:59.683 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:13:59.679+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:13:59.702 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:13:59.698+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:00.647 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:00.642+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:00.714 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:00.709+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:01.655 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:01.651+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:01.763 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:01.759+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:02.671 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:02.667+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:02.761 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:02.757+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:03.625 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:03.621+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:03.739 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:03.735+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:04.597 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:04.593+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:04.756 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:04.752+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:05.614 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:05.609+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:05.738 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:05.734+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:06.646 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:06.642+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:06.765 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:06.761+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:07.658 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:07.654+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:07.718 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:07.715+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:08.612 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:08.609+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:08.695 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:08.692+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:09.626 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:09.622+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:09.724 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:09.721+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:10.635 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:10.632+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:10.698 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:10.695+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:11.625 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:11.622+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:11.662 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:11.659+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:12.618 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:12.615+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:12.621 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:12.618+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:13.606 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:13.603+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:13.668 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:13.665+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:14.572 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:14.569+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:14.644 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:14.641+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:15.523 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:15.520+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:15.687 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:15.684+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:16.508 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:16.504+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:16.734 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:16.731+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:17.542 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:17.538+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:17.733 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:17.730+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:18.532 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:18.529+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:18.701 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:18.698+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:19.516 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:19.513+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:19.708 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:19.705+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:20.510 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:20.507+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:20.744 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:20.741+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:21.498 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:21.495+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:21.756 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:21.753+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:22.520 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:22.516+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:22.807 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:22.803+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:23.490 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:23.487+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:23.806 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:23.802+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:24.456 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:24.453+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:24.770 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:24.767+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:25.459 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:25.456+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:25.772 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:25.768+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:26.429 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:26.425+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:26.812 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:26.809+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:27.380 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:27.376+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:27.810 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:27.807+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:28.423 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:28.420+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:28.854 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:28.851+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:29.429 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:29.425+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:29.846 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:29.842+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:30.424 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:30.421+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:30.865 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:30.861+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:31.450 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:31.446+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:31.876 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:31.873+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:32.422 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:32.419+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:32.908 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:32.905+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:33.434 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:33.430+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:33.910 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:33.907+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:34.470 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:34.466+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:34.927 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:34.924+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:35.489 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:35.485+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:35.924 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:35.920+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:36.451 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:36.448+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:36.905 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:36.902+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:37.432 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:37.429+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:37.940 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:37.927+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:38.405 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:38.400+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:38.925 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:38.919+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:39.358 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:39.355+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:39.960 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:39.957+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:40.384 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:40.381+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:40.947 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:40.942+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:41.407 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:41.403+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:41.932 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:41.928+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:42.457 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:42.452+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:42.977 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:42.973+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:43.481 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:43.477+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:43.978 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:43.973+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:44.524 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:44.520+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:44.963 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:44.958+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:45.500 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:45.496+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:45.980 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:45.976+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:46.541 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:46.536+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:47.011 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:47.006+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:47.586 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:47.582+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:48.006 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:48.002+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:48.549 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:48.545+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:49.018 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:49.014+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:49.593 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:49.589+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:50.020 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:50.017+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:50.611 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:50.608+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:51.012 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:51.009+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:51.563 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:51.560+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:51.968 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:51.965+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:52.592 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:52.588+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:53.012 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:53.008+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:53.561 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:53.557+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:54.034 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:54.031+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:54.560 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:54.557+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:55.023 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:55.019+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:55.528 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:55.525+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:56.062 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:56.059+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:56.520 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:56.517+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:57.057 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:57.053+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:57.509 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:57.505+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:58.055 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:58.052+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:58.536 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:58.532+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:59.008 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:59.005+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:14:59.562 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:14:59.558+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:14:59.967 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:14:59.963+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:00.525 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:00.522+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:01.016 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:01.012+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:01.504 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:01.501+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:01.988 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:01.985+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:02.515 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:02.512+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:02.952 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:02.949+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:03.542 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:03.539+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:03.924 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:03.920+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:04.494 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:04.491+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:04.916 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:04.913+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:05.478 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:05.474+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:05.932 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:05.929+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:06.449 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:06.446+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:06.965 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:06.961+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:07.457 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:07.451+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:07.924 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:07.921+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:08.494 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:08.491+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:08.950 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:08.947+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:09.532 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:09.529+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:09.902 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:09.898+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:10.517 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:10.513+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:10.857 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:10.853+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:11.473 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:11.469+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:11.837 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:11.833+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:12.434 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:12.431+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:12.812 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:12.809+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:13.403 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:13.400+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:13.773 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:13.770+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:14.445 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:14.442+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:14.736 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:14.733+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:15.470 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:15.467+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:15.750 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:15.747+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:16.468 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:16.465+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:16.794 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:16.791+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:17.508 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:17.505+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:17.827 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:17.824+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:18.522 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:18.519+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:18.855 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:18.851+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:19.539 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:19.536+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:19.840 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:19.837+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:20.587 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:20.584+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:20.805 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:20.802+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:21.621 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:21.618+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:21.774 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:21.770+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:22.584 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:22.580+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:22.797 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:22.794+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:23.542 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:23.538+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:23.845 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:23.841+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:24.542 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:24.537+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:24.868 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:24.864+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:25.566 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:25.562+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:25.910 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:25.906+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:26.550 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:26.546+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:26.916 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:26.911+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:27.517 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:27.513+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:27.912 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:27.907+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:28.481 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:28.476+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:28.880 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:28.875+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:29.465 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:29.461+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:29.869 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:29.865+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:30.447 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:30.443+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:30.873 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:30.868+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:31.469 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:31.465+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:31.888 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:31.883+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:32.441 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:32.438+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:32.881 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:32.878+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:33.489 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:33.485+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:33.517 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T18:15:33.513+0000 7fa2a9acd700 0 -- 172.21.15.123:0/1871504539 >> [v2:172.21.15.123:6816/114455,v1:172.21.15.123:6817/114455] conn(0x7fa28c062060 msgr2=0x7fa28c032480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T18:15:33.867 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:33.864+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:34.486 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:34.483+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:34.761 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T18:15:34.758+0000 7fa2aa2ce700 0 -- 172.21.15.123:0/1871504539 >> [v2:172.21.15.123:6800/114439,v1:172.21.15.123:6801/114439] conn(0x7fa28c062060 msgr2=0x7fa28c03b170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T18:15:34.916 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:34.913+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:35.483 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:35.480+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:35.951 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:35.948+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:36.513 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:36.510+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:36.973 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:36.969+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:37.548 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:37.545+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:37.950 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:37.947+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:38.553 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:38.550+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:38.942 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:38.939+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:39.554 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:39.551+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:39.965 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:39.962+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:40.541 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:40.537+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:40.956 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:40.953+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:41.571 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:41.568+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:41.971 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:41.968+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:42.607 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:42.604+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:42.949 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:42.945+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:43.627 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:43.624+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:43.926 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:43.923+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:44.654 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:44.651+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:44.920 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:44.916+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:45.631 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:45.628+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:45.966 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:45.963+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:46.636 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:46.633+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:47.000 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:46.997+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:47.685 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:47.681+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:47.981 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:47.977+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:48.733 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:48.730+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:49.002 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:48.998+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:49.728 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:49.725+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:49.957 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:49.953+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:50.716 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:50.713+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:50.947 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:50.944+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:51.731 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:51.728+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:51.940 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:51.936+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:52.738 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:52.735+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:52.971 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:52.967+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:53.785 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:53.781+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:53.964 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:53.960+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:54.752 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:54.748+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:54.933 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:54.929+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:55.740 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:55.737+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:55.942 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:55.939+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:56.735 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:56.732+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:56.978 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:56.975+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:57.734 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:57.730+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:57.937 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:57.934+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:58.744 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:58.740+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:58.924 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:58.920+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:15:59.737 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:15:59.734+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:15:59.925 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:15:59.921+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:00.772 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:00.768+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:00.889 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:00.886+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:01.818 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:01.814+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:01.893 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:01.890+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:02.769 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:02.766+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:02.871 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:02.868+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:03.769 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:03.765+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:03.855 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:03.852+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:04.722 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:04.719+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:04.860 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:04.857+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:05.721 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:05.718+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:05.864 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:05.860+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:06.684 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:06.679+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:06.819 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:06.814+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:07.653 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:07.649+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:07.793 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:07.789+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:08.637 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:08.633+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:08.806 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:08.801+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:09.611 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:09.606+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:09.815 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:09.811+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:10.648 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:10.644+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:10.781 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:10.777+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:11.628 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:11.624+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:11.772 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:11.767+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:12.664 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:12.659+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:12.753 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:12.749+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:13.653 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:13.649+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:13.710 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:13.706+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:14.613 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:14.609+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:14.714 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:14.710+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:15.578 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:15.575+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:15.744 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:15.741+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:16.629 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:16.626+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:16.706 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:16.702+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:17.660 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:17.657+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:17.726 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:17.723+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:18.702 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:18.699+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:18.727 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:18.723+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:19.697 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:19.694+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:19.737 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:19.734+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:20.698 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:20.695+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:20.712 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:20.708+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:21.673 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:21.669+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:21.741 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:21.737+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:22.720 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:22.716+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:22.746 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:22.743+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:23.701 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:23.697+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:23.783 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:23.780+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:24.750 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:24.747+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:24.753 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:24.750+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:25.767 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:25.763+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:25.783 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:25.780+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:26.744 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:26.740+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:26.762 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:26.758+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:27.769 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:27.766+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:27.787 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:27.784+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:28.755 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:28.751+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:28.817 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:28.814+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:29.770 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:29.766+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:29.785 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:29.782+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:30.768 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:30.765+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:30.790 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:30.786+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:31.770 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:31.766+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:31.817 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:31.814+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:32.780 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:32.777+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:32.817 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:32.814+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:33.746 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:33.743+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:33.858 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:33.855+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:34.716 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:34.712+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:34.852 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:34.849+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:35.765 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:35.762+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:35.846 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:35.843+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:36.736 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:36.733+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:36.832 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:36.829+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:37.710 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:37.707+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:37.876 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:37.873+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:38.694 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:38.691+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:38.830 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:38.826+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:39.659 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:39.656+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:39.826 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:39.823+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:40.632 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:40.629+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:40.783 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:40.779+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:41.603 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:41.599+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:41.830 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:41.826+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:42.595 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:42.592+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:42.860 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:42.857+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:43.625 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:43.622+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:43.823 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:43.820+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:44.609 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:44.606+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:44.800 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:44.797+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:45.634 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:45.630+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:45.821 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:45.817+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:46.615 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:46.611+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:46.793 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:46.789+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:47.568 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:47.565+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:47.830 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:47.827+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:48.616 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:48.612+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:48.820 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:48.816+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:49.577 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:49.572+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:49.835 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:49.831+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:50.565 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:50.561+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:50.846 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:50.842+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:51.598 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:51.594+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:51.886 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:51.881+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:52.645 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:52.640+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:52.877 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:52.873+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:53.598 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:53.593+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:53.850 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:53.846+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:54.631 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:54.626+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:54.820 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:54.815+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:55.680 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:55.676+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:55.833 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:55.829+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:56.661 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:56.656+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:56.845 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:56.841+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:57.640 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:57.637+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:57.867 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:57.864+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:58.667 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:58.664+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:58.857 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:58.854+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:16:59.620 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:16:59.616+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:16:59.867 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:16:59.864+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:00.586 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:00.583+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:00.859 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:00.855+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:01.635 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:01.632+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:01.823 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:01.820+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:02.598 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:02.594+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:02.820 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:02.816+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:03.613 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:03.610+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:03.835 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:03.831+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:04.640 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:04.636+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:04.873 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:04.870+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:05.599 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:05.596+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:05.890 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:05.886+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:06.603 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:06.600+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:06.845 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:06.842+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:07.571 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:07.568+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:07.822 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:07.818+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:08.533 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:08.530+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:08.782 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:08.779+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:09.574 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:09.571+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:09.761 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:09.758+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:10.582 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:10.578+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:10.745 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:10.742+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:11.567 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:11.564+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:11.791 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:11.787+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:12.611 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:12.608+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:12.795 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:12.792+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:13.566 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:13.563+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:13.775 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:13.772+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:14.523 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:14.520+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:14.768 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:14.765+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:15.510 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:15.507+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:15.800 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:15.797+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:16.555 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:16.552+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:16.817 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:16.814+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:17.579 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:17.576+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:17.866 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:17.863+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:18.604 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:18.600+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:18.845 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:18.842+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:19.618 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:19.614+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:19.811 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:19.808+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:20.623 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:20.620+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:20.838 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:20.834+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:21.663 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:21.659+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:21.826 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:21.822+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:22.660 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:22.656+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:22.793 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:22.790+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:23.661 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:23.657+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:23.761 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:23.758+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:24.691 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:24.688+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:24.753 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:24.750+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:25.679 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:25.676+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:25.706 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:25.703+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:26.659 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:26.656+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:26.749 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:26.745+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:27.707 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:27.703+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:27.791 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:27.787+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:28.732 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:28.729+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:28.800 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:28.797+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:29.726 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:29.723+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:29.839 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:29.836+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:30.691 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:30.688+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:30.883 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:30.879+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:31.700 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:31.696+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:31.927 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:31.922+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:32.663 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:32.658+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:32.949 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:32.944+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:33.629 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:33.624+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:33.931 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:33.926+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:34.610 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:34.606+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:34.918 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:34.913+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:35.614 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:35.609+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:35.906 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:35.902+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:36.631 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:36.626+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:36.874 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:36.869+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:37.611 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:37.606+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:37.852 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:37.848+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:38.575 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:38.571+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:38.851 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:38.847+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:39.539 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:39.535+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:39.826 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:39.821+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:40.499 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:40.495+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:40.792 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:40.789+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:41.458 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:41.455+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:41.744 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:41.741+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:42.466 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:42.462+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:42.791 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:42.788+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:43.441 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:43.438+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:43.823 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:43.819+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:44.411 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:44.407+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:44.858 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:44.855+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:45.393 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:45.389+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:45.877 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:45.873+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:46.422 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:46.418+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:46.923 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:46.920+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:47.376 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:47.372+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:47.914 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:47.910+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:48.395 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:48.391+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:48.924 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:48.921+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:49.345 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:49.342+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:49.950 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:49.947+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:50.314 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:50.311+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:50.996 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:50.992+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:51.317 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:51.314+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:52.043 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:52.039+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:52.323 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:52.319+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:53.025 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:53.022+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:53.343 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:53.339+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:54.023 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:54.019+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:54.294 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:54.290+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:55.056 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:55.053+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:55.264 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:55.261+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:56.094 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:56.090+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:56.249 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:56.246+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:57.122 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:57.119+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:57.281 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:57.277+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:58.114 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:58.111+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:58.272 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:58.269+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:17:59.148 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:17:59.144+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:17:59.298 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:17:59.295+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:00.156 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:00.153+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:00.319 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:00.315+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:01.148 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:01.144+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:01.290 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:01.287+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:02.113 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:02.110+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:02.246 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:02.243+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:03.106 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:03.103+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:03.288 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:03.285+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:04.061 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:04.058+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:04.258 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:04.255+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:05.065 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:05.061+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:05.278 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:05.274+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:06.107 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:06.104+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:06.320 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:06.316+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:07.111 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:07.107+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:07.346 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:07.343+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:08.077 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:08.073+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:08.327 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:08.323+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:09.080 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:09.077+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:09.344 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:09.340+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:10.058 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:10.055+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:10.322 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:10.319+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:11.068 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:11.064+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:11.310 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:11.306+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:12.075 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:12.072+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:12.322 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:12.318+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:13.106 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:13.103+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:13.351 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:13.348+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:14.072 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:14.068+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:14.363 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:14.358+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:15.038 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:15.033+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:15.356 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:15.351+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:16.047 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:16.042+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:16.342 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:16.337+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:17.090 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:17.086+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:17.310 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:17.306+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:18.113 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:18.108+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:18.263 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:18.259+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:19.119 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:19.115+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:19.252 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:19.248+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:20.119 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:20.114+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:20.208 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:20.203+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:21.080 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:21.076+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:21.159 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:21.155+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:22.118 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:22.114+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:22.149 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:22.145+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:23.166 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:23.163+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:23.171 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:23.168+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:24.183 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:24.180+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:24.202 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:24.198+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:25.172 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:25.169+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:25.241 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:25.238+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:26.140 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:26.137+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:26.231 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:26.228+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:27.119 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:27.115+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:27.212 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:27.208+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:28.101 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:28.097+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:28.168 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:28.165+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:29.072 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:29.068+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:29.181 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:29.178+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:30.116 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:30.112+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:30.211 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:30.207+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:31.093 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:31.090+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:31.237 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:31.233+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:32.114 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:32.111+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:32.245 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:32.242+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:33.090 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:33.087+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:33.223 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:33.220+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:34.109 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:34.105+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:34.242 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:34.239+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:35.149 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:35.146+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:35.260 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:35.256+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:36.148 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:36.145+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:36.264 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:36.260+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:37.105 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:37.101+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:37.302 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:37.298+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:38.064 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:38.060+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:38.261 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:38.258+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:39.073 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:39.070+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:39.261 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:39.257+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:40.062 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:40.059+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:40.276 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:40.272+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:41.111 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:41.108+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:41.227 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:41.224+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:42.071 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:42.068+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:42.264 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:42.261+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:43.088 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:43.085+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:43.266 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:43.263+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:44.105 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:44.102+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:44.289 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:44.285+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:45.089 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:45.085+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:45.307 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:45.304+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:46.079 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:46.075+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:46.304 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:46.301+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:47.098 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:47.094+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:47.296 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:47.292+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:48.065 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:48.061+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:48.327 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:48.323+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:49.070 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:49.066+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:49.287 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:49.284+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:50.105 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:50.101+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:50.315 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:50.312+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:51.089 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:51.085+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:51.276 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:51.273+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:52.077 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:52.073+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:52.318 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:52.314+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:53.085 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:53.082+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:53.322 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:53.318+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:54.098 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:54.094+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:54.323 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:54.320+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:55.109 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:55.105+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:55.342 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:55.339+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:56.130 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:56.127+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:56.326 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:56.323+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:57.082 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:57.077+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:57.279 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:57.274+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:58.105 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:58.100+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:58.312 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:58.307+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:18:59.124 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:18:59.119+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:18:59.331 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:18:59.327+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:00.091 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:00.086+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:00.361 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:00.356+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:01.079 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:01.075+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:01.356 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:01.352+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:02.083 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:02.078+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:02.341 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:02.337+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:03.045 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:03.041+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:03.299 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:03.295+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:04.014 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:04.010+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:04.305 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:04.300+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:05.025 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:05.020+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:05.300 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:05.296+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:05.991 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:05.987+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:06.282 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:06.278+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:06.992 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:06.988+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:07.237 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:07.233+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:08.025 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:08.021+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:08.221 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:08.217+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:08.988 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:08.985+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:09.243 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:09.240+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:10.036 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:10.033+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:10.266 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:10.263+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:11.075 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:11.072+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:11.316 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:11.312+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:12.048 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:12.045+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:12.325 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:12.322+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:13.098 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:13.094+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:13.311 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:13.308+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:14.054 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:14.051+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:14.302 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:14.298+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:15.033 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:15.030+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:15.268 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:15.265+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:16.073 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:16.069+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:16.223 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:16.219+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:17.097 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:17.094+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:17.250 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:17.247+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:18.118 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:18.115+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:18.291 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:18.287+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:19.131 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:19.127+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:19.338 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:19.335+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:20.158 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:20.155+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:20.388 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:20.385+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:21.200 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:21.196+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:21.408 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:21.405+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:22.244 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:22.241+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:22.454 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:22.451+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:23.212 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:23.209+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:23.496 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:23.493+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:24.232 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:24.229+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:24.502 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:24.499+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:25.260 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:25.257+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:25.534 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:25.531+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:26.310 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:26.306+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:26.579 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:26.576+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:27.302 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:27.298+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:27.537 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:27.534+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:28.294 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:28.290+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:28.568 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:28.564+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:29.312 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:29.309+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:29.543 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:29.540+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:30.350 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:30.347+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:30.547 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:30.544+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:31.337 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:31.333+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:31.592 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:31.589+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:32.376 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:32.372+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:32.577 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:32.574+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:33.345 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:33.342+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:33.570 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:33.566+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:34.330 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:34.327+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:34.557 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:34.553+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:35.300 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:35.297+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:35.531 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:35.528+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:36.260 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:36.257+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:36.518 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:36.514+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:37.227 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:37.223+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:37.531 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:37.528+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:38.211 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:38.207+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:38.542 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:38.538+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:39.195 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:39.191+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:39.499 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:39.495+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:40.235 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:40.230+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:40.450 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:40.445+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:41.198 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:41.193+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:41.475 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:41.471+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:42.172 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:42.168+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:42.466 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:42.462+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:43.128 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:43.124+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:43.489 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:43.484+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:44.154 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:44.150+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:44.478 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:44.473+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:45.198 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:45.194+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:45.469 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:45.465+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:46.195 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:46.191+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:46.475 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:46.471+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:47.235 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:47.231+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:47.479 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:47.474+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:48.217 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:48.213+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:48.526 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:48.523+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:49.176 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:49.173+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:49.520 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:49.516+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:50.130 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:50.127+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:50.544 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:50.541+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:51.136 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:51.132+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:51.495 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:51.492+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:52.093 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:52.089+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:52.535 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:52.531+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:53.094 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:53.091+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:53.543 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:53.540+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:54.056 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:54.052+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:54.566 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:54.563+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:55.052 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:55.049+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:55.527 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:55.524+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:56.093 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:56.090+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:56.570 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:56.566+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:57.139 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:57.136+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:57.558 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:57.555+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:58.187 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:58.184+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:58.515 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:58.511+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:19:59.183 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:19:59.180+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:19:59.496 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:19:59.492+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:00.168 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:00.164+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:00.532 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:00.529+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:01.188 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:01.185+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:01.528 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:01.525+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:02.196 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:02.193+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:02.571 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:02.568+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:03.197 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:03.194+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:03.554 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:03.551+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:04.227 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:04.223+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:04.544 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:04.540+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:05.201 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:05.198+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:05.571 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:05.567+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:06.156 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:06.152+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:06.620 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:06.617+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:07.198 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:07.195+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:07.635 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:07.632+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:08.208 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:08.205+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:08.663 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:08.660+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:09.228 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:09.225+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:09.701 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:09.697+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:10.245 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:10.241+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:10.728 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:10.724+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:11.198 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:11.195+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:11.735 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:11.731+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:12.245 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:12.242+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:12.739 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:12.735+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:13.214 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:13.211+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:13.703 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:13.700+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:14.192 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:14.189+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:14.657 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:14.654+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:15.176 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:15.173+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:15.637 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:15.634+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:16.200 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:16.197+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:16.679 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:16.676+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:17.197 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:17.194+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:17.689 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:17.685+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:18.216 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:18.213+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:18.721 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:18.717+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:19.242 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:19.239+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:19.739 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:19.735+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:20.269 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:20.266+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:20.728 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:20.724+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:21.268 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:21.265+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:21.754 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:21.751+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:22.230 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:22.225+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:22.720 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:22.716+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:23.262 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:23.258+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:23.682 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:23.678+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:24.277 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:24.273+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:24.710 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:24.706+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:25.260 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:25.256+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:25.713 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:25.709+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:26.298 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:26.294+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:26.665 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:26.661+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:27.315 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:27.311+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:27.653 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:27.649+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:28.300 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:28.295+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:28.609 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:28.604+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:29.262 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:29.258+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:29.594 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:29.590+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:30.306 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:30.302+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:30.603 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:30.599+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:31.258 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:31.255+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:31.614 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:31.610+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:32.272 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:32.269+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:32.622 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:32.618+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:33.280 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:33.277+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:33.597 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:33.593+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:34.276 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:34.273+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:34.645 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:34.642+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:35.296 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:35.293+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:35.676 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:35.673+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:36.256 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:36.252+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:36.662 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:36.659+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:37.210 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:37.207+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:37.624 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:37.620+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:38.244 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:38.241+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:38.601 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:38.598+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:39.271 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:39.268+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:39.622 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:39.618+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:40.284 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:40.281+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:40.582 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:40.578+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:41.327 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:41.324+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:41.614 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:41.611+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:42.352 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:42.349+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:42.653 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:42.650+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:43.318 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:43.315+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:43.626 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:43.622+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:44.358 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:44.355+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:44.613 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:44.610+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:45.390 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:45.387+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:45.614 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:45.610+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:46.378 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:46.374+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:46.642 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:46.639+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:47.393 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:47.390+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:47.679 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:47.675+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:48.420 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:48.417+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:48.676 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:48.672+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:49.466 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:49.463+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:49.725 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:49.721+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:50.418 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:50.414+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:50.766 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:50.763+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:51.381 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:51.378+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:51.777 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:51.774+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:52.431 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:52.427+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:52.808 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:52.804+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:53.388 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:53.384+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:53.820 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:53.816+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:54.430 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:54.426+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:54.850 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:54.847+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:55.450 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:55.447+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:55.844 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:55.841+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:56.498 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:56.495+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:56.834 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:56.831+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:57.506 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:57.503+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:57.815 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:57.812+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:58.477 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:58.474+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:58.794 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:58.791+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:20:59.503 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:20:59.500+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:20:59.758 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:20:59.755+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:00.474 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:00.470+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:00.797 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:00.793+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:01.458 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:01.455+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:01.768 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:01.765+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:02.460 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:02.456+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:02.726 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:02.723+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:03.456 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:03.453+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:03.760 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:03.757+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:04.504 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:04.501+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:04.763 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:04.759+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:05.470 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:05.466+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:05.805 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:05.800+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:06.502 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:06.498+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:06.765 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:06.761+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:07.476 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:07.472+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:07.794 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:07.790+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:08.527 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:08.522+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:08.775 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:08.771+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:09.512 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:09.508+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:09.778 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:09.774+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:10.549 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:10.545+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:10.734 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:10.730+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:11.505 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:11.501+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:11.702 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:11.698+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:12.513 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:12.509+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:12.720 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:12.716+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:13.470 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:13.466+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:13.680 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:13.677+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:14.480 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:14.476+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:14.660 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:14.657+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:15.440 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:15.437+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:15.690 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:15.687+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:16.449 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:16.445+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:16.660 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:16.656+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:17.489 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:17.486+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:17.650 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:17.647+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:18.485 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:18.481+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:18.692 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:18.689+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:19.494 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:19.490+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:19.644 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:19.641+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:20.485 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:20.482+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:20.668 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:20.664+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:21.481 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:21.478+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:21.637 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:21.633+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:22.516 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:22.513+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:22.655 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:22.651+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:23.500 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:23.497+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:23.648 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:23.644+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:24.537 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:24.533+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:24.620 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:24.617+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:25.490 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:25.487+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:25.595 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:25.592+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:26.524 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:26.520+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:26.594 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:26.591+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:27.568 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:27.565+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:27.611 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:27.608+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:28.611 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:28.608+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:28.621 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:28.617+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:29.616 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:29.613+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:29.622 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:29.619+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:30.576 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:30.572+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:30.664 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:30.661+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:31.610 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:31.607+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:31.709 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:31.706+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:32.642 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:32.639+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:32.706 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:32.702+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:33.634 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:33.631+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:33.661 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:33.658+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:34.657 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:34.653+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:34.670 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:34.667+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:35.648 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:35.644+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:35.695 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:35.692+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:36.646 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:36.643+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:36.714 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:36.711+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:37.608 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:37.605+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:37.758 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:37.755+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:38.641 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:38.638+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:38.744 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:38.740+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:39.681 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:39.678+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:39.766 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:39.762+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:40.708 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:40.705+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:40.805 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:40.802+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:41.712 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:41.709+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:41.756 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:41.753+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:42.681 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:42.677+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:42.753 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:42.749+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:43.676 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:43.673+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:43.767 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:43.764+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:44.663 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:44.660+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:44.778 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:44.774+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:45.627 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:45.624+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:45.736 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:45.733+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:46.675 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:46.672+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:46.757 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:46.753+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:47.662 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:47.658+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:47.746 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:47.742+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:48.627 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:48.623+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:48.796 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:48.792+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:49.645 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:49.640+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:49.773 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:49.769+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:50.665 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:50.660+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:50.759 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:50.755+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:51.707 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:51.703+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:51.788 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:51.784+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:52.694 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:52.690+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:52.759 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:52.755+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:53.704 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:53.700+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:53.769 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:53.764+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:54.697 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:54.693+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:54.766 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:54.761+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:55.673 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:55.669+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:55.804 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:55.800+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:56.640 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:56.635+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:56.843 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:56.839+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:57.646 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:57.642+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:57.828 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:57.825+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:58.669 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:58.666+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:58.784 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:58.781+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:21:59.627 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:21:59.624+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:21:59.760 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:21:59.757+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:00.653 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:00.649+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:00.797 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:00.794+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:01.641 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:01.637+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:01.820 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:01.817+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:02.688 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:02.685+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:02.841 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:02.837+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:03.673 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:03.670+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:03.828 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:03.824+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:04.707 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:04.704+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:04.869 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:04.866+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:05.670 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:05.666+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:05.823 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:05.819+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:06.659 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:06.656+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:06.803 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:06.799+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:07.611 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:07.608+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:07.815 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:07.812+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:08.635 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:08.632+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:08.852 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:08.849+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:09.603 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:09.600+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:09.831 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:09.828+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:10.582 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:10.578+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:10.873 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:10.870+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:11.576 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:11.573+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:11.901 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:11.898+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:12.574 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:12.571+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:12.878 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:12.874+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:13.534 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:13.530+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:13.868 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:13.865+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:14.489 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:14.486+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:14.833 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:14.827+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:15.517 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:15.514+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:15.878 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:15.875+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:16.537 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:16.534+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:16.925 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:16.922+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:17.553 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:17.550+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:17.878 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:17.875+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:18.551 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:18.548+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:18.860 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:18.856+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:19.592 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:19.588+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:19.855 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:19.851+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:20.564 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:20.561+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:20.895 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:20.891+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:21.531 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:21.528+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:21.901 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:21.897+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:22.499 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:22.496+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:22.908 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:22.905+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:23.505 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:23.501+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:23.893 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:23.889+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:24.474 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:24.471+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:24.908 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:24.905+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:25.451 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:25.448+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:25.890 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:25.886+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:26.414 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:26.411+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:26.844 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:26.840+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:27.454 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:27.451+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:27.826 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:27.823+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:28.505 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:28.501+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:28.782 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:28.776+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:29.461 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:29.457+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:29.825 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:29.822+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:30.441 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:30.438+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:30.813 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:30.808+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:31.447 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:31.443+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:31.847 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:31.843+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:32.401 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:32.396+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:32.828 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:32.823+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:33.440 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:33.436+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:33.819 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:33.814+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:34.461 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:34.456+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:34.805 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:34.801+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:35.436 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:35.432+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:35.785 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:35.781+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:36.398 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:36.394+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:36.805 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:36.801+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:37.371 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:37.367+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:37.832 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:37.828+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:38.402 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:38.397+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:38.811 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:38.807+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:39.358 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:39.354+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:39.798 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:39.794+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:40.334 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:40.331+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:40.790 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:40.786+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:41.383 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:41.380+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:41.838 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:41.835+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:42.398 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:42.395+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:42.850 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:42.847+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:43.367 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:43.363+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:43.821 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:43.817+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:44.413 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:44.409+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:44.839 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:44.836+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:45.392 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:45.388+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:45.807 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:45.804+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:46.435 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:46.432+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:46.759 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:46.755+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:47.400 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:47.396+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:47.758 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:47.755+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:48.364 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:48.361+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:48.714 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:48.710+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:49.354 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:49.350+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:49.741 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:49.738+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:50.324 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:50.321+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:50.758 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:50.755+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:51.352 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:51.348+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:51.798 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:51.794+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:52.399 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:52.396+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:52.783 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:52.780+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:53.403 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:53.400+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:53.779 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:53.776+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:54.428 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:54.425+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:54.742 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:54.738+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:55.460 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:55.456+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:55.726 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:55.723+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:56.461 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:56.458+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:56.704 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:56.701+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:57.503 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:57.499+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:57.710 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:57.707+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:58.464 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:58.461+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:58.744 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:58.741+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:22:59.505 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:22:59.502+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:22:59.748 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:22:59.745+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:00.510 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:00.506+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:00.759 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:00.755+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:01.534 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:01.530+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:01.766 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:01.762+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:02.488 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:02.485+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:02.798 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:02.794+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:03.525 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:03.522+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:03.830 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:03.827+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:04.534 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:04.531+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:04.784 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:04.780+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:05.559 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:05.554+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:05.796 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:05.793+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:06.582 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:06.575+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:06.773 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:06.770+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:07.604 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:07.601+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:07.747 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:07.743+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:08.603 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:08.599+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:08.775 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:08.772+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:09.611 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:09.607+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:09.824 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:09.821+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:10.656 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:10.653+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:10.776 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:10.773+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:11.632 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:11.629+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:11.742 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:11.739+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:12.609 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:12.606+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:12.729 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:12.726+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:13.564 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:13.559+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:13.694 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:13.690+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:14.609 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:14.605+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:14.674 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:14.670+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:15.647 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:15.642+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:15.680 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:15.676+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:16.648 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:16.644+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:16.655 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:16.651+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:17.633 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:17.629+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:17.676 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:17.672+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:18.659 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:18.654+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:18.663 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:18.659+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:19.692 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:19.687+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:19.703 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:19.698+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:20.678 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:20.673+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:20.732 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:20.727+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:21.680 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:21.675+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:21.756 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:21.752+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:22.711 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:22.707+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:22.781 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:22.778+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:23.724 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:23.721+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:23.733 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:23.730+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:24.729 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:24.726+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:24.766 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:24.762+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:25.734 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:25.731+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:25.765 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:25.762+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:26.749 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:26.746+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:26.801 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:26.798+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:27.707 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:27.704+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:27.783 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:27.780+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:28.710 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:28.706+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:28.759 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:28.756+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:29.711 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:29.708+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:29.718 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:29.715+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:30.709 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:30.706+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:30.730 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:30.726+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:31.748 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:31.745+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:31.781 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:31.777+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:32.735 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:32.732+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:32.778 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:32.775+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:33.751 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:33.748+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:33.771 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:33.768+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:34.773 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:34.770+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:34.780 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:34.777+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:35.757 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:35.753+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:35.786 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:35.783+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:36.733 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:36.730+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:36.743 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:36.740+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:37.743 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:37.740+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:37.777 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:37.774+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:38.741 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:38.737+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:38.763 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:38.760+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:39.722 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:39.719+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:39.748 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:39.744+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:40.734 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:40.731+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:40.743 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:40.740+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:41.750 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:41.747+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:41.766 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:41.763+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:42.793 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:42.790+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:42.806 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:42.803+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:43.836 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:43.832+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:43.836 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:43.833+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:44.812 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:44.808+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:44.843 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:44.840+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:45.807 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:45.804+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:45.812 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:45.808+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:46.772 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:46.769+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:46.803 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:46.800+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:47.774 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:47.771+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:47.802 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:47.798+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:48.761 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:48.758+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:48.783 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:48.779+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:49.751 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:49.747+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:49.813 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:49.808+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:50.773 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:50.769+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:50.837 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:50.834+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:51.745 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:51.742+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:51.880 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:51.877+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:52.743 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:52.740+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:52.924 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:52.921+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:53.759 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:53.756+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:53.961 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:53.957+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:54.713 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:54.710+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:54.993 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:54.990+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:55.693 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:55.690+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:55.984 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:55.981+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:56.674 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:56.669+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:57.000 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:56.996+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:57.684 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:57.680+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:57.958 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:57.954+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:58.718 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:58.714+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:58.928 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:58.924+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:23:59.744 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:23:59.740+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:23:59.972 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:23:59.968+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:00.781 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:00.777+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:00.941 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:00.936+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:01.798 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:01.793+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:01.946 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:01.941+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:02.813 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:02.809+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:02.979 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:02.974+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:03.822 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:03.818+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:03.990 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:03.986+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:04.864 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:04.860+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:04.988 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:04.984+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:05.915 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:05.912+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:06.021 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:06.018+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:06.938 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:06.935+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:07.018 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:07.015+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:07.928 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:07.925+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:08.026 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:08.023+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:08.928 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:08.925+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:09.062 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:09.059+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:09.906 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:09.903+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:10.102 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:10.098+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:10.870 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:10.866+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:11.056 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:11.053+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:11.855 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:11.851+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:12.098 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:12.094+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:12.836 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:12.833+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:13.076 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:13.072+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:13.865 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:13.862+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:14.086 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:14.082+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:14.907 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:14.904+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:15.069 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:15.066+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:15.913 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:15.910+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:16.052 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:16.049+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:16.902 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:16.898+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:17.057 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:17.054+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:17.934 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:17.931+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:18.015 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:18.012+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:18.907 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:18.904+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:18.978 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:18.975+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:19.939 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:19.935+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:20.008 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:20.005+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:20.899 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:20.896+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:20.968 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:20.965+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:21.889 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:21.885+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:21.940 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:21.937+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:22.865 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:22.862+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:22.951 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:22.948+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:23.864 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:23.861+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:23.905 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:23.902+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:24.848 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:24.844+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:24.934 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:24.931+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:25.849 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:25.846+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:25.890 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:25.886+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:26.820 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:26.817+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:26.908 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:26.904+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:27.853 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:27.850+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:27.893 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:27.890+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:28.860 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:28.857+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:28.891 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:28.888+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:29.814 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:29.811+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:29.874 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:29.871+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:30.849 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:30.846+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:30.923 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:30.920+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:31.814 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:31.811+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:31.934 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:31.931+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:32.776 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:32.772+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:32.961 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:32.957+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:33.748 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:33.745+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:33.938 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:33.935+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:34.758 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:34.754+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:34.989 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:34.986+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:35.795 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:35.792+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:35.993 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:35.990+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:36.833 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:36.829+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:36.983 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:36.979+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:37.861 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:37.858+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:37.995 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:37.991+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:38.900 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:38.896+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:38.960 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:38.957+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:39.890 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:39.885+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:39.964 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:39.960+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:40.900 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:40.896+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:40.983 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:40.979+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:41.889 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:41.885+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:41.995 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:41.991+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:42.848 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:42.844+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:42.953 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:42.949+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:43.870 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:43.865+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:43.959 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:43.955+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:44.853 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:44.848+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:44.989 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:44.984+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:45.870 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:45.866+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:45.940 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:45.936+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:46.875 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:46.871+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:46.953 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:46.949+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:47.868 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:47.864+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:47.944 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:47.940+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:48.822 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:48.818+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:48.990 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:48.987+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:49.785 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:49.781+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:50.001 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:49.998+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:50.738 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:50.734+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:51.025 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:51.022+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:51.759 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:51.756+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:52.029 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:52.026+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:52.724 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:52.721+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:52.997 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:52.994+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:53.768 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:53.765+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:53.974 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:53.971+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:54.724 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:54.721+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:54.974 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:54.971+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:55.757 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:55.754+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:56.007 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:56.004+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:56.732 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:56.728+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:56.958 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:56.955+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:57.770 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:57.767+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:57.929 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:57.925+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:58.783 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:58.779+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:58.892 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:58.889+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:24:59.771 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:24:59.768+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:24:59.938 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:24:59.934+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:00.818 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:00.815+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:00.960 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:00.956+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:01.782 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:01.779+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:01.938 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:01.935+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:02.813 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:02.810+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:02.917 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:02.914+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:03.797 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:03.793+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:03.963 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:03.960+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:04.828 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:04.825+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:05.014 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:05.011+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:05.860 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:05.857+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:06.031 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:06.028+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:06.847 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:06.844+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:07.080 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:07.076+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:07.851 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:07.848+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:08.065 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:08.062+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:08.848 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:08.845+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:09.052 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:09.049+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:09.861 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:09.858+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:10.034 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:10.031+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:10.887 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:10.884+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:11.050 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:11.046+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:11.853 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:11.850+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:12.086 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:12.082+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:12.853 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:12.850+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:13.040 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:13.037+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:13.875 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:13.872+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:14.028 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:14.025+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:14.838 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:14.835+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:15.010 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:15.006+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:15.799 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:15.796+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:16.001 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:15.997+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:16.793 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:16.790+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:16.979 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:16.976+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:17.754 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:17.750+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:17.982 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:17.979+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:18.803 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:18.799+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:19.019 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:19.016+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:19.798 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:19.795+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:20.013 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:20.010+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:20.831 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:20.828+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:21.060 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:21.057+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:21.877 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:21.874+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:22.075 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:22.071+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:22.897 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:22.893+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:23.092 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:23.088+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:23.888 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:23.884+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:24.064 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:24.060+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:24.867 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:24.863+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:25.099 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:25.095+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:25.851 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:25.847+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:26.113 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:26.108+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:26.813 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:26.809+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:27.086 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:27.082+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:27.861 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:27.857+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:28.045 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:28.041+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:28.856 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:28.852+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:29.081 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:29.077+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:29.811 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:29.806+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:30.115 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:30.110+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:30.770 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:30.766+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:31.096 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:31.092+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:31.786 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:31.783+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:32.080 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:32.076+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:32.774 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:32.771+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:33.050 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:33.047+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:33.750 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:33.747+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:34.031 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:34.028+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:34.704 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:34.701+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:35.077 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:35.074+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:35.702 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:35.698+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:36.031 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:36.028+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:36.664 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:36.661+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:37.039 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:37.036+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:37.712 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:37.708+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:38.071 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:38.067+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:38.737 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:38.734+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:39.097 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:39.094+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:39.740 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:39.737+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:40.117 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:40.114+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:40.699 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:40.696+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:41.106 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:41.103+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:41.674 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:41.670+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:42.058 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:42.055+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:42.700 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:42.697+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:43.028 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:43.025+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:43.706 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:43.703+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:44.068 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:44.065+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:44.756 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:44.753+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:45.102 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:45.099+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:45.707 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:45.704+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:46.147 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:46.144+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:46.715 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:46.712+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:47.138 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:47.135+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:47.748 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:47.745+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:48.159 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:48.155+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:48.790 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:48.787+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:49.189 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:49.186+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:49.836 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:49.833+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:50.144 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:50.141+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:50.830 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:50.827+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:51.136 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:51.133+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:51.787 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:51.784+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:52.135 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:52.132+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:52.790 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:52.786+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:53.164 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:53.160+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:53.767 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:53.764+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:54.178 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:54.175+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:54.735 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:54.732+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:55.200 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:55.197+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:55.758 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:55.754+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:56.156 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:56.153+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:56.798 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:56.795+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:57.114 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:57.111+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:57.816 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:57.812+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:58.136 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:58.133+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:58.813 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:58.810+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:25:59.100 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:25:59.097+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:25:59.828 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:25:59.825+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:00.139 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:00.136+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:00.842 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:00.839+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:01.147 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:01.143+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:01.870 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:01.867+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:02.121 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:02.118+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:02.852 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:02.849+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:03.149 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:03.146+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:03.838 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:03.834+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:04.126 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:04.123+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:04.819 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:04.816+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:05.101 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:05.098+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:05.796 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:05.791+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:06.142 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:06.138+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:06.754 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:06.750+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:07.157 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:07.153+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:07.783 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:07.779+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:08.148 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:08.143+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:08.811 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:08.807+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:09.187 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:09.183+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:09.832 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:09.827+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:10.154 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:10.149+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:10.845 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:10.841+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:11.198 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:11.192+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:11.835 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:11.831+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:12.246 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:12.242+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:12.820 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:12.816+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:13.235 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:13.231+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:13.785 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:13.781+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:14.242 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:14.237+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:14.785 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:14.781+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:15.248 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:15.245+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:15.808 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:15.805+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:16.277 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:16.273+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:16.792 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:16.789+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:17.293 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:17.290+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:17.776 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:17.773+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:18.301 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:18.298+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:18.796 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:18.793+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:19.262 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:19.258+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:19.824 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:19.821+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:20.293 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:20.290+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:20.794 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:20.791+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:21.269 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:21.265+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:21.760 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:21.757+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:22.276 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:22.273+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:22.712 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:22.709+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:23.327 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:23.323+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:23.751 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:23.748+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:24.333 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:24.330+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:24.706 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:24.702+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:25.335 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:25.332+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:25.743 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:25.740+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:26.368 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:26.365+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:26.712 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:26.709+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:27.374 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:27.371+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:27.740 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:27.737+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:28.362 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:28.358+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:28.777 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:28.774+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:29.395 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:29.392+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:29.741 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:29.738+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:30.388 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:30.385+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:30.711 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:30.708+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:31.365 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:31.361+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:31.759 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:31.756+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:32.348 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:32.345+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:32.795 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:32.792+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:33.310 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:33.307+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:33.784 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:33.781+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:34.286 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:34.283+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:34.772 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:34.769+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:35.298 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:35.295+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:35.780 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:35.776+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:36.252 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:36.249+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:36.792 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:36.788+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:37.290 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:37.287+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:37.788 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:37.784+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:38.306 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:38.302+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:38.836 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:38.833+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:39.329 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:39.326+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:39.822 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:39.819+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:40.308 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:40.305+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:40.835 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:40.831+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:41.282 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:41.278+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:41.817 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:41.813+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:42.238 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:42.235+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:42.814 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:42.810+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:43.218 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:43.215+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:43.840 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:43.837+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:44.261 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:44.258+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:44.267 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-12-06T18:26:44.268 INFO:tasks.workunit.client.0.smithi123.stderr:2023-12-06T18:26:44.264+0000 7fa289ffb700 -1 received signal: Terminated from (PID: 118494) UID: 1000 2023-12-06T18:26:44.799 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:44.796+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:45.310 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:45.307+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:45.762 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:45.759+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:46.342 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:46.339+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:46.741 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:46.737+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:47.334 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:47.331+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:47.761 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:47.758+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:48.351 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:48.346+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:48.717 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:48.713+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:49.343 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:49.339+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:49.740 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:49.736+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:50.362 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:50.358+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:50.700 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:50.695+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:51.323 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:51.318+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:51.665 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:51.661+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:52.348 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:52.343+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:52.668 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:52.663+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:53.363 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:53.359+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:53.704 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:53.700+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:54.383 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:54.379+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:54.745 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:54.741+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:55.379 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:55.374+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:55.725 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:55.721+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:56.366 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:56.362+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:56.736 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:56.732+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:57.394 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:57.390+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:57.713 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:57.710+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:58.433 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:58.429+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:58.675 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:58.672+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:26:59.453 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:26:59.449+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:26:59.689 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:26:59.685+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:00.404 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:00.401+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:00.662 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:00.659+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:01.439 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:01.435+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:01.670 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:01.667+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:02.419 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:02.415+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:02.650 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:02.647+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:03.398 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:03.394+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:03.680 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:03.676+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:04.379 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:04.376+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:04.649 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:04.645+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:05.394 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:05.391+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:05.604 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:05.600+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:06.394 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:06.391+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:06.643 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:06.640+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:07.369 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:07.366+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:07.644 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:07.641+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:08.401 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:08.397+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:08.675 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:08.672+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:09.390 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:09.387+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:09.652 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:09.649+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:10.425 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:10.422+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:10.651 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:10.648+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:11.464 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:11.461+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:11.668 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:11.664+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:12.445 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:12.442+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:12.711 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:12.707+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:13.397 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:13.393+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:13.733 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:13.730+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:14.401 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:14.398+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:14.702 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:14.699+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:15.353 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:15.349+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:15.721 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:15.718+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:16.359 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:16.356+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:16.685 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:16.682+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:17.318 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:17.314+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:17.736 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:17.733+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:18.364 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:18.361+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:18.693 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:18.690+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:19.340 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:19.337+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:19.646 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:19.643+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:20.337 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:20.334+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:20.631 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:20.628+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:21.373 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:21.370+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:21.598 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:21.595+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:22.385 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:22.382+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:22.598 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:22.595+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:23.429 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:23.426+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:23.558 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:23.555+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:24.433 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:24.430+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:24.530 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:24.527+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:25.418 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:25.415+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:25.547 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:25.544+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:26.425 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:26.421+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:26.590 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:26.586+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:27.443 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:27.440+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:27.639 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:27.636+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:28.453 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:28.450+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:28.671 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:28.668+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:29.444 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:29.441+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:29.651 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:29.647+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:30.399 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:30.395+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:30.619 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:30.616+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:31.447 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:31.443+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:31.578 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:31.574+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:32.410 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:32.405+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:32.567 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:32.563+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:33.457 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:33.453+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:33.545 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:33.540+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:34.422 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:34.418+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:34.591 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:34.586+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:35.421 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:35.417+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:35.598 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:35.593+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:36.409 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:36.404+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:36.645 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:36.641+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:37.399 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:37.395+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:37.625 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:37.621+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:38.392 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:38.383+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:38.634 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:38.630+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:39.423 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:39.419+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:39.612 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:39.608+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:40.418 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:40.415+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:40.629 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:40.626+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:41.398 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:41.395+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:41.603 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:41.600+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:42.449 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:42.446+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:42.564 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:42.561+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:43.425 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:43.421+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:43.607 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:43.604+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:44.268 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2023-12-06T18:27:44.411 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:44.408+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:44.599 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:44.596+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:45.447 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:45.444+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:45.621 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:45.618+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:46.479 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:46.476+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:46.647 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:46.644+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:47.487 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:47.484+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:47.621 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:47.618+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:48.511 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:48.508+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:48.611 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:48.608+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:49.503 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:49.500+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:49.634 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:49.630+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:50.457 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:50.454+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:50.605 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:50.602+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:51.436 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:51.432+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:51.655 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:51.652+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:52.419 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:52.415+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:52.622 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:52.619+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:53.393 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:53.389+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:53.643 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:53.639+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:54.346 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:54.342+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:54.649 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:54.646+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:55.368 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:55.365+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:55.665 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:55.661+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:56.321 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:56.318+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:56.695 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:56.692+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:57.353 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:57.350+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:57.721 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:57.718+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:58.370 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:58.366+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:58.697 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:58.694+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:27:59.409 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:27:59.406+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:27:59.726 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:27:59.723+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:00.442 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:00.439+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:00.717 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:00.714+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:01.484 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:01.480+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:01.741 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:01.738+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:02.513 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:02.510+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:02.744 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:02.741+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:03.491 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:03.488+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:03.761 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:03.758+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:04.492 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:04.489+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:04.749 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:04.745+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:05.491 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:05.488+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:05.792 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:05.789+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:06.503 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:06.500+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:06.780 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:06.777+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:07.551 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:07.548+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:07.819 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:07.816+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:08.555 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:08.552+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:08.812 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:08.808+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:09.561 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:09.558+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:09.763 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:09.760+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:10.545 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:10.542+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:10.716 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:10.712+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:11.573 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:11.570+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:11.684 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:11.681+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:12.540 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:12.537+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:12.650 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:12.647+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:13.539 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:13.535+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:13.666 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:13.663+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:14.537 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:14.533+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:14.667 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:14.663+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:15.524 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:15.520+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:15.665 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:15.660+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:16.536 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:16.532+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:16.692 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:16.688+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:17.507 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:17.503+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:17.644 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:17.639+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:18.465 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:18.461+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:18.686 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:18.682+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:19.493 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:19.488+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:19.702 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:19.698+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:20.537 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:20.533+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:20.737 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:20.733+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:21.566 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:21.502+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:21.701 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:21.697+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:22.533 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:22.529+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:22.688 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:22.684+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:23.538 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:23.535+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:23.710 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:23.707+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:24.572 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:24.569+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:24.720 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:24.717+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:25.539 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:25.536+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:25.724 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:25.721+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:26.549 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:26.546+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:26.682 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:26.679+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:27.594 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:27.585+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:27.661 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:27.657+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:28.622 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:28.619+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:28.638 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:28.635+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:29.629 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:29.625+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:29.650 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:29.646+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:30.613 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:30.610+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:30.615 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:30.612+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:31.570 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:31.567+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:31.613 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:31.610+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:32.578 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:32.575+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:32.591 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:32.588+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:33.546 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:33.543+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:33.553 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:33.549+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:34.520 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:34.516+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:34.539 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:34.536+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:35.504 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:35.501+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:35.539 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:35.536+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:36.543 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:36.540+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:36.575 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:36.572+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:37.506 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:37.503+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:37.620 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:37.617+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:38.518 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:38.515+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:38.658 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:38.655+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:39.476 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:39.473+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:39.708 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:39.705+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:40.480 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:40.477+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:40.684 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:40.681+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:41.444 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:41.441+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:41.683 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:41.680+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:42.458 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:42.454+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:42.708 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:42.705+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:43.424 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:43.420+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:43.715 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:43.712+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:44.269 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2023-12-06T18:28:44.270 INFO:tasks.workunit:Stopping ['rbd/cli_generic.sh'] on client.0... 2023-12-06T18:28:44.270 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-06T18:28:44.473 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:44.470+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:44.526 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_d03fca4f35d43f61b4679936aef7bd2f01cced0b/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_d03fca4f35d43f61b4679936aef7bd2f01cced0b/qa/tasks/workunit.py", line 423, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rbd/cli_generic.sh) on smithi123 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d03fca4f35d43f61b4679936aef7bd2f01cced0b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh' 2023-12-06T18:28:44.616 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=82a938fb608a45008aeabfcc22f1f701 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_d03fca4f35d43f61b4679936aef7bd2f01cced0b/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_d03fca4f35d43f61b4679936aef7bd2f01cced0b/qa/tasks/workunit.py", line 423, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rbd/cli_generic.sh) on smithi123 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d03fca4f35d43f61b4679936aef7bd2f01cced0b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh' 2023-12-06T18:28:44.618 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-06T18:28:44.641 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-12-06T18:28:44.642 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-06T18:28:44.749 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:44.745+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:44.951 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T18:28:44.951 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":156,"fsid":"d9839fb7-f14a-4da0-b485-65c61122611f","created":"2023-12-06T15:25:38.200058+0000","modified":"2023-12-06T16:28:58.726896+0000","last_up_change":"2023-12-06T15:25:46.189008+0000","last_in_change":"2023-12-06T15:25:39.179248+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-06T15:25:46.228677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-06T15:25:46.870005+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"15","last_force_op_resend_prenautilus":"15","last_force_op_resend_preluminous":"15","auid":0,"snap_mode":"selfmanaged","snap_seq":91,"snap_epoch":151,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[3],"tier_of":-1,"read_tier":3,"write_tier":3,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cache","create_time":"2023-12-06T15:25:53.092415+0000","flags":8201,"flags_names":"hashpspool,incomplete_clones,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"15","last_force_op_resend_prenautilus":"15","last_force_op_resend_preluminous":"15","auid":0,"snap_mode":"selfmanaged","snap_seq":91,"snap_epoch":151,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":2,"read_tier":-1,"write_tier":-1,"cache_mode":"writeback","target_max_bytes":0,"target_max_objects":250,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"bloom","false_positive_probability":0.050000000000000003,"target_size":0,"seed":0},"hit_set_period":60,"hit_set_count":8,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"8aca3223-ca02-4768-8194-522c80e4cab0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":114439},{"type":"v1","addr":"172.21.15.123:6801","nonce":114439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":114439},{"type":"v1","addr":"172.21.15.123:6803","nonce":114439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":114439},{"type":"v1","addr":"172.21.15.123:6807","nonce":114439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":114439},{"type":"v1","addr":"172.21.15.123:6805","nonce":114439}]},"public_addr":"172.21.15.123:6801/114439","cluster_addr":"172.21.15.123:6803/114439","heartbeat_back_addr":"172.21.15.123:6807/114439","heartbeat_front_addr":"172.21.15.123:6805/114439","state":["exists","up"]},{"osd":1,"uuid":"00bd97ad-a075-4a29-8402-47a59cafeaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":114455},{"type":"v1","addr":"172.21.15.123:6817","nonce":114455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":114455},{"type":"v1","addr":"172.21.15.123:6819","nonce":114455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":114455},{"type":"v1","addr":"172.21.15.123:6823","nonce":114455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":114455},{"type":"v1","addr":"172.21.15.123:6821","nonce":114455}]},"public_addr":"172.21.15.123:6817/114455","cluster_addr":"172.21.15.123:6819/114455","heartbeat_back_addr":"172.21.15.123:6823/114455","heartbeat_front_addr":"172.21.15.123:6821/114455","state":["exists","up"]},{"osd":2,"uuid":"022162d6-8d34-40d4-8386-8c2eaa3880d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":114440},{"type":"v1","addr":"172.21.15.123:6809","nonce":114440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":114440},{"type":"v1","addr":"172.21.15.123:6811","nonce":114440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":114440},{"type":"v1","addr":"172.21.15.123:6815","nonce":114440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":114440},{"type":"v1","addr":"172.21.15.123:6813","nonce":114440}]},"public_addr":"172.21.15.123:6809/114440","cluster_addr":"172.21.15.123:6811/114440","heartbeat_back_addr":"172.21.15.123:6815/114440","heartbeat_front_addr":"172.21.15.123:6813/114440","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T15:25:44.297358+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T15:25:44.369755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T15:25:44.324521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":4,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]},{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]},{"pool":6,"snaps":[{"begin":4,"length":1}]},{"pool":7,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-06T18:28:44.966 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-06T18:28:44.967 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T18:28:45.261 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T18:28:45.263 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2023-12-06T18:28:45.274 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":5642,"stamp":"2023-12-06T18:28:44.759783+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":790567370,"num_objects":480,"num_object_clones":2,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":385,"num_whiteouts":157,"num_read":65638,"num_read_kb":143338,"num_write":18424,"num_write_kb":8837004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":16,"num_bytes_hit_set_archive":3604,"num_flush":799,"num_flush_kb":22094,"num_evict":1905,"num_evict_kb":137723,"num_promote":2101,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25739,"ondisk_log_size":25739,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1381204,"kb_used_data":452668,"kb_used_omap":0,"kb_used_meta":928512,"kb_avail":281734316,"statfs":{"total":289910292480,"available":288495939584,"internally_reserved":0,"allocated":463532032,"data_stored":461234860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":950796288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001960"},"pg_stats":[{"pgid":"2.7","version":"153'998","reported_seq":1985,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729083+0000","last_change":"2023-12-06T15:30:17.617146+0000","last_active":"2023-12-06T16:28:53.729083+0000","last_peered":"2023-12-06T16:28:53.729083+0000","last_clean":"2023-12-06T16:28:53.729083+0000","last_became_active":"2023-12-06T15:25:48.206888+0000","last_became_peered":"2023-12-06T15:25:48.206888+0000","last_unstale":"2023-12-06T16:28:53.729083+0000","last_undegraded":"2023-12-06T16:28:53.729083+0000","last_fullsized":"2023-12-06T16:28:53.729083+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":998,"ondisk_log_size":998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":106983625,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":814,"num_read_kb":2793,"num_write":872,"num_write_kb":1182412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"153'847","reported_seq":1720,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729016+0000","last_change":"2023-12-06T15:30:17.617250+0000","last_active":"2023-12-06T16:28:53.729016+0000","last_peered":"2023-12-06T16:28:53.729016+0000","last_clean":"2023-12-06T16:28:53.729016+0000","last_became_active":"2023-12-06T15:25:48.206986+0000","last_became_peered":"2023-12-06T15:25:48.206986+0000","last_unstale":"2023-12-06T16:28:53.729016+0000","last_undegraded":"2023-12-06T16:28:53.729016+0000","last_fullsized":"2023-12-06T16:28:53.729016+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":847,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":47205134,"num_objects":21,"num_object_clones":1,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":1,"num_read":583,"num_read_kb":897,"num_write":705,"num_write_kb":1089454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"153'781","reported_seq":1738,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728965+0000","last_change":"2023-12-06T15:30:17.617011+0000","last_active":"2023-12-06T16:28:53.728965+0000","last_peered":"2023-12-06T16:28:53.728965+0000","last_clean":"2023-12-06T16:28:53.728965+0000","last_became_active":"2023-12-06T15:25:48.206906+0000","last_became_peered":"2023-12-06T15:25:48.206906+0000","last_unstale":"2023-12-06T16:28:53.728965+0000","last_undegraded":"2023-12-06T16:28:53.728965+0000","last_fullsized":"2023-12-06T16:28:53.728965+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":781,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":40385513,"num_objects":26,"num_object_clones":1,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":771,"num_read_kb":4540,"num_write":652,"num_write_kb":964008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"153'3349","reported_seq":8242,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728490+0000","last_change":"2023-12-06T15:30:17.622402+0000","last_active":"2023-12-06T16:28:53.728490+0000","last_peered":"2023-12-06T16:28:53.728490+0000","last_clean":"2023-12-06T16:28:53.728490+0000","last_became_active":"2023-12-06T15:25:54.220756+0000","last_became_peered":"2023-12-06T15:25:54.220756+0000","last_unstale":"2023-12-06T16:28:53.728490+0000","last_undegraded":"2023-12-06T16:28:53.728490+0000","last_fullsized":"2023-12-06T16:28:53.728490+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":3349,"ondisk_log_size":3349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51299121,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":38,"num_read":12130,"num_read_kb":27934,"num_write":2245,"num_write_kb":1738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":719,"num_flush":173,"num_flush_kb":6205,"num_evict":482,"num_evict_kb":39117,"num_promote":533,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"153'1364","reported_seq":2318,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:55.328086+0000","last_change":"2023-12-06T15:30:17.614750+0000","last_active":"2023-12-06T16:28:55.328086+0000","last_peered":"2023-12-06T16:28:55.328086+0000","last_clean":"2023-12-06T16:28:55.328086+0000","last_became_active":"2023-12-06T15:25:48.204290+0000","last_became_peered":"2023-12-06T15:25:48.204290+0000","last_unstale":"2023-12-06T16:28:55.328086+0000","last_undegraded":"2023-12-06T16:28:55.328086+0000","last_fullsized":"2023-12-06T16:28:55.328086+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":1364,"ondisk_log_size":1364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":73011320,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":688,"num_read_kb":4922,"num_write":819,"num_write_kb":1094364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"153'3641","reported_seq":9475,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728910+0000","last_change":"2023-12-06T15:30:17.620567+0000","last_active":"2023-12-06T16:28:53.728910+0000","last_peered":"2023-12-06T16:28:53.728910+0000","last_clean":"2023-12-06T16:28:53.728910+0000","last_became_active":"2023-12-06T15:25:54.223136+0000","last_became_peered":"2023-12-06T15:25:54.223136+0000","last_unstale":"2023-12-06T16:28:53.728910+0000","last_undegraded":"2023-12-06T16:28:53.728910+0000","last_fullsized":"2023-12-06T16:28:53.728910+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":3641,"ondisk_log_size":3641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11076424,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":42,"num_read":10502,"num_read_kb":28911,"num_write":1839,"num_write_kb":767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":805,"num_flush":189,"num_flush_kb":1977,"num_evict":486,"num_evict_kb":35620,"num_promote":533,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":150,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728781+0000","last_change":"2023-12-06T15:25:48.207167+0000","last_active":"2023-12-06T16:28:53.728781+0000","last_peered":"2023-12-06T16:28:53.728781+0000","last_clean":"2023-12-06T16:28:53.728781+0000","last_became_active":"2023-12-06T15:25:48.206870+0000","last_became_peered":"2023-12-06T15:25:48.206870+0000","last_unstale":"2023-12-06T16:28:53.728781+0000","last_undegraded":"2023-12-06T16:28:53.728781+0000","last_fullsized":"2023-12-06T16:28:53.728781+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"153'1386","reported_seq":2258,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729136+0000","last_change":"2023-12-06T15:30:17.616899+0000","last_active":"2023-12-06T16:28:53.729136+0000","last_peered":"2023-12-06T16:28:53.729136+0000","last_clean":"2023-12-06T16:28:53.729136+0000","last_became_active":"2023-12-06T15:25:48.205750+0000","last_became_peered":"2023-12-06T15:25:48.205750+0000","last_unstale":"2023-12-06T16:28:53.729136+0000","last_undegraded":"2023-12-06T16:28:53.729136+0000","last_fullsized":"2023-12-06T16:28:53.729136+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":1386,"ondisk_log_size":1386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":91811925,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":601,"num_read_kb":4028,"num_write":820,"num_write_kb":1199092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"153'6456","reported_seq":14785,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728858+0000","last_change":"2023-12-06T15:30:17.621570+0000","last_active":"2023-12-06T16:28:53.728858+0000","last_peered":"2023-12-06T16:28:53.728858+0000","last_clean":"2023-12-06T16:28:53.728858+0000","last_became_active":"2023-12-06T15:25:54.221489+0000","last_became_peered":"2023-12-06T15:25:54.221489+0000","last_unstale":"2023-12-06T16:28:53.728858+0000","last_undegraded":"2023-12-06T16:28:53.728858+0000","last_fullsized":"2023-12-06T16:28:53.728858+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":6456,"ondisk_log_size":6456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":42890638,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":35,"num_read":24199,"num_read_kb":36879,"num_write":5231,"num_write_kb":3994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1414,"num_flush":231,"num_flush_kb":8685,"num_evict":509,"num_evict_kb":32296,"num_promote":556,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"153'887","reported_seq":1765,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:55.328085+0000","last_change":"2023-12-06T15:30:17.614745+0000","last_active":"2023-12-06T16:28:55.328085+0000","last_peered":"2023-12-06T16:28:55.328085+0000","last_clean":"2023-12-06T16:28:55.328085+0000","last_became_active":"2023-12-06T15:25:48.205967+0000","last_became_peered":"2023-12-06T15:25:48.205967+0000","last_unstale":"2023-12-06T16:28:55.328085+0000","last_undegraded":"2023-12-06T16:28:55.328085+0000","last_fullsized":"2023-12-06T16:28:55.328085+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":887,"ondisk_log_size":887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":113639590,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":664,"num_read_kb":403,"num_write":770,"num_write_kb":1081998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"153'4090","reported_seq":11085,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728527+0000","last_change":"2023-12-06T15:30:17.622674+0000","last_active":"2023-12-06T16:28:53.728527+0000","last_peered":"2023-12-06T16:28:53.728527+0000","last_clean":"2023-12-06T16:28:53.728527+0000","last_became_active":"2023-12-06T15:25:54.221304+0000","last_became_peered":"2023-12-06T15:25:54.221304+0000","last_unstale":"2023-12-06T16:28:53.728527+0000","last_undegraded":"2023-12-06T16:28:53.728527+0000","last_fullsized":"2023-12-06T16:28:53.728527+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":4090,"ondisk_log_size":4090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":41243290,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":40,"num_read":13526,"num_read_kb":30612,"num_write":2847,"num_write_kb":2055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":666,"num_flush":206,"num_flush_kb":5227,"num_evict":428,"num_evict_kb":30690,"num_promote":479,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"153'1069","reported_seq":1936,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728491+0000","last_change":"2023-12-06T15:30:17.621662+0000","last_active":"2023-12-06T16:28:53.728491+0000","last_peered":"2023-12-06T16:28:53.728491+0000","last_clean":"2023-12-06T16:28:53.728491+0000","last_became_active":"2023-12-06T15:25:48.204147+0000","last_became_peered":"2023-12-06T15:25:48.204147+0000","last_unstale":"2023-12-06T16:28:53.728491+0000","last_undegraded":"2023-12-06T16:28:53.728491+0000","last_fullsized":"2023-12-06T16:28:53.728491+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":1069,"ondisk_log_size":1069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127537306,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":556,"num_read_kb":811,"num_write":921,"num_write_kb":1173359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"153'871","reported_seq":1776,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728908+0000","last_change":"2023-12-06T15:30:17.620795+0000","last_active":"2023-12-06T16:28:53.728908+0000","last_peered":"2023-12-06T16:28:53.728908+0000","last_clean":"2023-12-06T16:28:53.728908+0000","last_became_active":"2023-12-06T15:25:48.204913+0000","last_became_peered":"2023-12-06T15:25:48.204913+0000","last_unstale":"2023-12-06T16:28:53.728908+0000","last_undegraded":"2023-12-06T16:28:53.728908+0000","last_fullsized":"2023-12-06T16:28:53.728908+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":871,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":43483484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":604,"num_read_kb":608,"num_write":703,"num_write_kb":1043763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":146509473,"num_objects":216,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":155,"num_read":60357,"num_read_kb":124336,"num_write":12162,"num_write_kb":8554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":16,"num_bytes_hit_set_archive":3604,"num_flush":799,"num_flush_kb":22094,"num_evict":1905,"num_evict_kb":137723,"num_promote":2101,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":187801600,"data_stored":187645250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17536,"ondisk_log_size":17536,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":644057897,"num_objects":264,"num_object_clones":2,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264,"num_whiteouts":2,"num_read":5281,"num_read_kb":19002,"num_write":6262,"num_write_kb":8828450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":271777792,"data_stored":271513170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8203,"ondisk_log_size":8203,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740569,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":444440,"kb_used_data":134928,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93927400,"statfs":{"total":96636764160,"available":96181657600,"internally_reserved":0,"allocated":138166272,"data_stored":137425212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 18:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.23200000000000001,"5min":0.23300000000000001,"15min":0.22600000000000001},"min":{"1min":0.17799999999999999,"5min":0.155,"15min":0.14099999999999999},"max":{"1min":0.42299999999999999,"5min":0.441,"15min":0.48699999999999999},"last":0.218},{"interface":"front","average":{"1min":0.249,"5min":0.24299999999999999,"15min":0.23400000000000001},"min":{"1min":0.20000000000000001,"5min":0.17000000000000001,"15min":0.16300000000000001},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.46100000000000002},"last":0.247}]},{"osd":1,"last update":"Wed Dec 6 18:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.251,"5min":0.251,"15min":0.246},"min":{"1min":0.188,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.48799999999999999},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.27900000000000003,"15min":0.27200000000000002},"min":{"1min":0.23599999999999999,"5min":0.19800000000000001,"15min":0.17100000000000001},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.28599999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740568,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":468184,"kb_used_data":158672,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93903656,"statfs":{"total":96636764160,"available":96157343744,"internally_reserved":0,"allocated":162480128,"data_stored":161733705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 18:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.23000000000000001,"5min":0.215,"15min":0.215},"min":{"1min":0.154,"5min":0.14399999999999999,"15min":0.13200000000000001},"max":{"1min":0.38900000000000001,"5min":0.434,"15min":0.45000000000000001},"last":0.14699999999999999},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.25700000000000001,"15min":0.247},"min":{"1min":0.21199999999999999,"5min":0.159,"15min":0.155},"max":{"1min":0.439,"5min":0.439,"15min":0.47099999999999997},"last":0.20100000000000001}]},{"osd":2,"last update":"Wed Dec 6 18:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.248,"5min":0.22600000000000001,"15min":0.22700000000000001},"min":{"1min":0.17799999999999999,"5min":0.16800000000000001,"15min":0.152},"max":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.47899999999999998},"last":0.17599999999999999},{"interface":"front","average":{"1min":0.255,"5min":0.23699999999999999,"15min":0.24099999999999999},"min":{"1min":0.186,"5min":0.185,"15min":0.17399999999999999},"max":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.48399999999999999},"last":0.218}]}]},{"osd":1,"up_from":8,"seq":34359740568,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":468580,"kb_used_data":159068,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93903260,"statfs":{"total":96636764160,"available":96156938240,"internally_reserved":0,"allocated":162885632,"data_stored":162075943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 18:28:01 2023","interfaces":[{"interface":"back","average":{"1min":0.19900000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"min":{"1min":0.13600000000000001,"5min":0.13600000000000001,"15min":0.13600000000000001},"max":{"1min":0.35699999999999998,"5min":0.46600000000000003,"15min":0.48599999999999999},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.25800000000000001,"5min":0.26700000000000002,"15min":0.26800000000000002},"min":{"1min":0.19900000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.433,"5min":0.48699999999999999,"15min":0.504},"last":0.255}]},{"osd":2,"last update":"Wed Dec 6 18:28:01 2023","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.46000000000000002},"last":0.19700000000000001},{"interface":"front","average":{"1min":0.23799999999999999,"5min":0.24299999999999999,"15min":0.24399999999999999},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.214}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":92942336,"data_stored":92846518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":135888896,"data_stored":135756585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":42946560,"data_stored":42910067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68222976,"data_stored":68195787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25677824,"data_stored":25626838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":93900800,"data_stored":93822625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T18:28:45.276 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T18:28:45.437 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:45.434+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:45.568 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T18:28:45.570 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2023-12-06T18:28:45.582 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":5642,"stamp":"2023-12-06T18:28:44.759783+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":790567370,"num_objects":480,"num_object_clones":2,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":385,"num_whiteouts":157,"num_read":65638,"num_read_kb":143338,"num_write":18424,"num_write_kb":8837004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":16,"num_bytes_hit_set_archive":3604,"num_flush":799,"num_flush_kb":22094,"num_evict":1905,"num_evict_kb":137723,"num_promote":2101,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25739,"ondisk_log_size":25739,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1381204,"kb_used_data":452668,"kb_used_omap":0,"kb_used_meta":928512,"kb_avail":281734316,"statfs":{"total":289910292480,"available":288495939584,"internally_reserved":0,"allocated":463532032,"data_stored":461234860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":950796288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001960"},"pg_stats":[{"pgid":"2.7","version":"153'998","reported_seq":1985,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729083+0000","last_change":"2023-12-06T15:30:17.617146+0000","last_active":"2023-12-06T16:28:53.729083+0000","last_peered":"2023-12-06T16:28:53.729083+0000","last_clean":"2023-12-06T16:28:53.729083+0000","last_became_active":"2023-12-06T15:25:48.206888+0000","last_became_peered":"2023-12-06T15:25:48.206888+0000","last_unstale":"2023-12-06T16:28:53.729083+0000","last_undegraded":"2023-12-06T16:28:53.729083+0000","last_fullsized":"2023-12-06T16:28:53.729083+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":998,"ondisk_log_size":998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":106983625,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":814,"num_read_kb":2793,"num_write":872,"num_write_kb":1182412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"153'847","reported_seq":1720,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729016+0000","last_change":"2023-12-06T15:30:17.617250+0000","last_active":"2023-12-06T16:28:53.729016+0000","last_peered":"2023-12-06T16:28:53.729016+0000","last_clean":"2023-12-06T16:28:53.729016+0000","last_became_active":"2023-12-06T15:25:48.206986+0000","last_became_peered":"2023-12-06T15:25:48.206986+0000","last_unstale":"2023-12-06T16:28:53.729016+0000","last_undegraded":"2023-12-06T16:28:53.729016+0000","last_fullsized":"2023-12-06T16:28:53.729016+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":847,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":47205134,"num_objects":21,"num_object_clones":1,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":1,"num_read":583,"num_read_kb":897,"num_write":705,"num_write_kb":1089454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"153'781","reported_seq":1738,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728965+0000","last_change":"2023-12-06T15:30:17.617011+0000","last_active":"2023-12-06T16:28:53.728965+0000","last_peered":"2023-12-06T16:28:53.728965+0000","last_clean":"2023-12-06T16:28:53.728965+0000","last_became_active":"2023-12-06T15:25:48.206906+0000","last_became_peered":"2023-12-06T15:25:48.206906+0000","last_unstale":"2023-12-06T16:28:53.728965+0000","last_undegraded":"2023-12-06T16:28:53.728965+0000","last_fullsized":"2023-12-06T16:28:53.728965+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":781,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":40385513,"num_objects":26,"num_object_clones":1,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":771,"num_read_kb":4540,"num_write":652,"num_write_kb":964008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"153'3349","reported_seq":8242,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728490+0000","last_change":"2023-12-06T15:30:17.622402+0000","last_active":"2023-12-06T16:28:53.728490+0000","last_peered":"2023-12-06T16:28:53.728490+0000","last_clean":"2023-12-06T16:28:53.728490+0000","last_became_active":"2023-12-06T15:25:54.220756+0000","last_became_peered":"2023-12-06T15:25:54.220756+0000","last_unstale":"2023-12-06T16:28:53.728490+0000","last_undegraded":"2023-12-06T16:28:53.728490+0000","last_fullsized":"2023-12-06T16:28:53.728490+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":3349,"ondisk_log_size":3349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51299121,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":38,"num_read":12130,"num_read_kb":27934,"num_write":2245,"num_write_kb":1738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":719,"num_flush":173,"num_flush_kb":6205,"num_evict":482,"num_evict_kb":39117,"num_promote":533,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"153'1364","reported_seq":2318,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:55.328086+0000","last_change":"2023-12-06T15:30:17.614750+0000","last_active":"2023-12-06T16:28:55.328086+0000","last_peered":"2023-12-06T16:28:55.328086+0000","last_clean":"2023-12-06T16:28:55.328086+0000","last_became_active":"2023-12-06T15:25:48.204290+0000","last_became_peered":"2023-12-06T15:25:48.204290+0000","last_unstale":"2023-12-06T16:28:55.328086+0000","last_undegraded":"2023-12-06T16:28:55.328086+0000","last_fullsized":"2023-12-06T16:28:55.328086+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":1364,"ondisk_log_size":1364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":73011320,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":688,"num_read_kb":4922,"num_write":819,"num_write_kb":1094364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"153'3641","reported_seq":9475,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728910+0000","last_change":"2023-12-06T15:30:17.620567+0000","last_active":"2023-12-06T16:28:53.728910+0000","last_peered":"2023-12-06T16:28:53.728910+0000","last_clean":"2023-12-06T16:28:53.728910+0000","last_became_active":"2023-12-06T15:25:54.223136+0000","last_became_peered":"2023-12-06T15:25:54.223136+0000","last_unstale":"2023-12-06T16:28:53.728910+0000","last_undegraded":"2023-12-06T16:28:53.728910+0000","last_fullsized":"2023-12-06T16:28:53.728910+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":3641,"ondisk_log_size":3641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11076424,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":42,"num_read":10502,"num_read_kb":28911,"num_write":1839,"num_write_kb":767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":805,"num_flush":189,"num_flush_kb":1977,"num_evict":486,"num_evict_kb":35620,"num_promote":533,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":150,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728781+0000","last_change":"2023-12-06T15:25:48.207167+0000","last_active":"2023-12-06T16:28:53.728781+0000","last_peered":"2023-12-06T16:28:53.728781+0000","last_clean":"2023-12-06T16:28:53.728781+0000","last_became_active":"2023-12-06T15:25:48.206870+0000","last_became_peered":"2023-12-06T15:25:48.206870+0000","last_unstale":"2023-12-06T16:28:53.728781+0000","last_undegraded":"2023-12-06T16:28:53.728781+0000","last_fullsized":"2023-12-06T16:28:53.728781+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"153'1386","reported_seq":2258,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729136+0000","last_change":"2023-12-06T15:30:17.616899+0000","last_active":"2023-12-06T16:28:53.729136+0000","last_peered":"2023-12-06T16:28:53.729136+0000","last_clean":"2023-12-06T16:28:53.729136+0000","last_became_active":"2023-12-06T15:25:48.205750+0000","last_became_peered":"2023-12-06T15:25:48.205750+0000","last_unstale":"2023-12-06T16:28:53.729136+0000","last_undegraded":"2023-12-06T16:28:53.729136+0000","last_fullsized":"2023-12-06T16:28:53.729136+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":1386,"ondisk_log_size":1386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":91811925,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":601,"num_read_kb":4028,"num_write":820,"num_write_kb":1199092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"153'6456","reported_seq":14785,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728858+0000","last_change":"2023-12-06T15:30:17.621570+0000","last_active":"2023-12-06T16:28:53.728858+0000","last_peered":"2023-12-06T16:28:53.728858+0000","last_clean":"2023-12-06T16:28:53.728858+0000","last_became_active":"2023-12-06T15:25:54.221489+0000","last_became_peered":"2023-12-06T15:25:54.221489+0000","last_unstale":"2023-12-06T16:28:53.728858+0000","last_undegraded":"2023-12-06T16:28:53.728858+0000","last_fullsized":"2023-12-06T16:28:53.728858+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":6456,"ondisk_log_size":6456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":42890638,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":35,"num_read":24199,"num_read_kb":36879,"num_write":5231,"num_write_kb":3994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1414,"num_flush":231,"num_flush_kb":8685,"num_evict":509,"num_evict_kb":32296,"num_promote":556,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"153'887","reported_seq":1765,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:55.328085+0000","last_change":"2023-12-06T15:30:17.614745+0000","last_active":"2023-12-06T16:28:55.328085+0000","last_peered":"2023-12-06T16:28:55.328085+0000","last_clean":"2023-12-06T16:28:55.328085+0000","last_became_active":"2023-12-06T15:25:48.205967+0000","last_became_peered":"2023-12-06T15:25:48.205967+0000","last_unstale":"2023-12-06T16:28:55.328085+0000","last_undegraded":"2023-12-06T16:28:55.328085+0000","last_fullsized":"2023-12-06T16:28:55.328085+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":887,"ondisk_log_size":887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":113639590,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":664,"num_read_kb":403,"num_write":770,"num_write_kb":1081998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"153'4090","reported_seq":11085,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728527+0000","last_change":"2023-12-06T15:30:17.622674+0000","last_active":"2023-12-06T16:28:53.728527+0000","last_peered":"2023-12-06T16:28:53.728527+0000","last_clean":"2023-12-06T16:28:53.728527+0000","last_became_active":"2023-12-06T15:25:54.221304+0000","last_became_peered":"2023-12-06T15:25:54.221304+0000","last_unstale":"2023-12-06T16:28:53.728527+0000","last_undegraded":"2023-12-06T16:28:53.728527+0000","last_fullsized":"2023-12-06T16:28:53.728527+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":4090,"ondisk_log_size":4090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":41243290,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":40,"num_read":13526,"num_read_kb":30612,"num_write":2847,"num_write_kb":2055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":666,"num_flush":206,"num_flush_kb":5227,"num_evict":428,"num_evict_kb":30690,"num_promote":479,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"153'1069","reported_seq":1936,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728491+0000","last_change":"2023-12-06T15:30:17.621662+0000","last_active":"2023-12-06T16:28:53.728491+0000","last_peered":"2023-12-06T16:28:53.728491+0000","last_clean":"2023-12-06T16:28:53.728491+0000","last_became_active":"2023-12-06T15:25:48.204147+0000","last_became_peered":"2023-12-06T15:25:48.204147+0000","last_unstale":"2023-12-06T16:28:53.728491+0000","last_undegraded":"2023-12-06T16:28:53.728491+0000","last_fullsized":"2023-12-06T16:28:53.728491+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":1069,"ondisk_log_size":1069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127537306,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":556,"num_read_kb":811,"num_write":921,"num_write_kb":1173359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"153'871","reported_seq":1776,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728908+0000","last_change":"2023-12-06T15:30:17.620795+0000","last_active":"2023-12-06T16:28:53.728908+0000","last_peered":"2023-12-06T16:28:53.728908+0000","last_clean":"2023-12-06T16:28:53.728908+0000","last_became_active":"2023-12-06T15:25:48.204913+0000","last_became_peered":"2023-12-06T15:25:48.204913+0000","last_unstale":"2023-12-06T16:28:53.728908+0000","last_undegraded":"2023-12-06T16:28:53.728908+0000","last_fullsized":"2023-12-06T16:28:53.728908+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":871,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":43483484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":604,"num_read_kb":608,"num_write":703,"num_write_kb":1043763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":146509473,"num_objects":216,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":155,"num_read":60357,"num_read_kb":124336,"num_write":12162,"num_write_kb":8554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":16,"num_bytes_hit_set_archive":3604,"num_flush":799,"num_flush_kb":22094,"num_evict":1905,"num_evict_kb":137723,"num_promote":2101,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":187801600,"data_stored":187645250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17536,"ondisk_log_size":17536,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":644057897,"num_objects":264,"num_object_clones":2,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264,"num_whiteouts":2,"num_read":5281,"num_read_kb":19002,"num_write":6262,"num_write_kb":8828450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":271777792,"data_stored":271513170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8203,"ondisk_log_size":8203,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740569,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":444440,"kb_used_data":134928,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93927400,"statfs":{"total":96636764160,"available":96181657600,"internally_reserved":0,"allocated":138166272,"data_stored":137425212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 18:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.23200000000000001,"5min":0.23300000000000001,"15min":0.22600000000000001},"min":{"1min":0.17799999999999999,"5min":0.155,"15min":0.14099999999999999},"max":{"1min":0.42299999999999999,"5min":0.441,"15min":0.48699999999999999},"last":0.218},{"interface":"front","average":{"1min":0.249,"5min":0.24299999999999999,"15min":0.23400000000000001},"min":{"1min":0.20000000000000001,"5min":0.17000000000000001,"15min":0.16300000000000001},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.46100000000000002},"last":0.247}]},{"osd":1,"last update":"Wed Dec 6 18:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.251,"5min":0.251,"15min":0.246},"min":{"1min":0.188,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.48799999999999999},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.27900000000000003,"15min":0.27200000000000002},"min":{"1min":0.23599999999999999,"5min":0.19800000000000001,"15min":0.17100000000000001},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.28599999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740568,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":468184,"kb_used_data":158672,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93903656,"statfs":{"total":96636764160,"available":96157343744,"internally_reserved":0,"allocated":162480128,"data_stored":161733705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 18:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.23000000000000001,"5min":0.215,"15min":0.215},"min":{"1min":0.154,"5min":0.14399999999999999,"15min":0.13200000000000001},"max":{"1min":0.38900000000000001,"5min":0.434,"15min":0.45000000000000001},"last":0.14699999999999999},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.25700000000000001,"15min":0.247},"min":{"1min":0.21199999999999999,"5min":0.159,"15min":0.155},"max":{"1min":0.439,"5min":0.439,"15min":0.47099999999999997},"last":0.20100000000000001}]},{"osd":2,"last update":"Wed Dec 6 18:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.248,"5min":0.22600000000000001,"15min":0.22700000000000001},"min":{"1min":0.17799999999999999,"5min":0.16800000000000001,"15min":0.152},"max":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.47899999999999998},"last":0.17599999999999999},{"interface":"front","average":{"1min":0.255,"5min":0.23699999999999999,"15min":0.24099999999999999},"min":{"1min":0.186,"5min":0.185,"15min":0.17399999999999999},"max":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.48399999999999999},"last":0.218}]}]},{"osd":1,"up_from":8,"seq":34359740568,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":468580,"kb_used_data":159068,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93903260,"statfs":{"total":96636764160,"available":96156938240,"internally_reserved":0,"allocated":162885632,"data_stored":162075943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 18:28:01 2023","interfaces":[{"interface":"back","average":{"1min":0.19900000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"min":{"1min":0.13600000000000001,"5min":0.13600000000000001,"15min":0.13600000000000001},"max":{"1min":0.35699999999999998,"5min":0.46600000000000003,"15min":0.48599999999999999},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.25800000000000001,"5min":0.26700000000000002,"15min":0.26800000000000002},"min":{"1min":0.19900000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.433,"5min":0.48699999999999999,"15min":0.504},"last":0.255}]},{"osd":2,"last update":"Wed Dec 6 18:28:01 2023","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.46000000000000002},"last":0.19700000000000001},{"interface":"front","average":{"1min":0.23799999999999999,"5min":0.24299999999999999,"15min":0.24399999999999999},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.214}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":92942336,"data_stored":92846518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":135888896,"data_stored":135756585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":42946560,"data_stored":42910067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68222976,"data_stored":68195787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25677824,"data_stored":25626838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":93900800,"data_stored":93822625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T18:28:45.583 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-06T18:28:45.583 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T18:28:45.742 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:45.739+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:45.889 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T18:28:45.890 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2023-12-06T18:28:45.901 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":5642,"stamp":"2023-12-06T18:28:44.759783+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":790567370,"num_objects":480,"num_object_clones":2,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":385,"num_whiteouts":157,"num_read":65638,"num_read_kb":143338,"num_write":18424,"num_write_kb":8837004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":16,"num_bytes_hit_set_archive":3604,"num_flush":799,"num_flush_kb":22094,"num_evict":1905,"num_evict_kb":137723,"num_promote":2101,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25739,"ondisk_log_size":25739,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1381204,"kb_used_data":452668,"kb_used_omap":0,"kb_used_meta":928512,"kb_avail":281734316,"statfs":{"total":289910292480,"available":288495939584,"internally_reserved":0,"allocated":463532032,"data_stored":461234860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":950796288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001960"},"pg_stats":[{"pgid":"2.7","version":"153'998","reported_seq":1985,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729083+0000","last_change":"2023-12-06T15:30:17.617146+0000","last_active":"2023-12-06T16:28:53.729083+0000","last_peered":"2023-12-06T16:28:53.729083+0000","last_clean":"2023-12-06T16:28:53.729083+0000","last_became_active":"2023-12-06T15:25:48.206888+0000","last_became_peered":"2023-12-06T15:25:48.206888+0000","last_unstale":"2023-12-06T16:28:53.729083+0000","last_undegraded":"2023-12-06T16:28:53.729083+0000","last_fullsized":"2023-12-06T16:28:53.729083+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":998,"ondisk_log_size":998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":106983625,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":814,"num_read_kb":2793,"num_write":872,"num_write_kb":1182412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"153'847","reported_seq":1720,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729016+0000","last_change":"2023-12-06T15:30:17.617250+0000","last_active":"2023-12-06T16:28:53.729016+0000","last_peered":"2023-12-06T16:28:53.729016+0000","last_clean":"2023-12-06T16:28:53.729016+0000","last_became_active":"2023-12-06T15:25:48.206986+0000","last_became_peered":"2023-12-06T15:25:48.206986+0000","last_unstale":"2023-12-06T16:28:53.729016+0000","last_undegraded":"2023-12-06T16:28:53.729016+0000","last_fullsized":"2023-12-06T16:28:53.729016+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":847,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":47205134,"num_objects":21,"num_object_clones":1,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":1,"num_read":583,"num_read_kb":897,"num_write":705,"num_write_kb":1089454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"153'781","reported_seq":1738,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728965+0000","last_change":"2023-12-06T15:30:17.617011+0000","last_active":"2023-12-06T16:28:53.728965+0000","last_peered":"2023-12-06T16:28:53.728965+0000","last_clean":"2023-12-06T16:28:53.728965+0000","last_became_active":"2023-12-06T15:25:48.206906+0000","last_became_peered":"2023-12-06T15:25:48.206906+0000","last_unstale":"2023-12-06T16:28:53.728965+0000","last_undegraded":"2023-12-06T16:28:53.728965+0000","last_fullsized":"2023-12-06T16:28:53.728965+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":781,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":40385513,"num_objects":26,"num_object_clones":1,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":771,"num_read_kb":4540,"num_write":652,"num_write_kb":964008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"153'3349","reported_seq":8242,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728490+0000","last_change":"2023-12-06T15:30:17.622402+0000","last_active":"2023-12-06T16:28:53.728490+0000","last_peered":"2023-12-06T16:28:53.728490+0000","last_clean":"2023-12-06T16:28:53.728490+0000","last_became_active":"2023-12-06T15:25:54.220756+0000","last_became_peered":"2023-12-06T15:25:54.220756+0000","last_unstale":"2023-12-06T16:28:53.728490+0000","last_undegraded":"2023-12-06T16:28:53.728490+0000","last_fullsized":"2023-12-06T16:28:53.728490+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":3349,"ondisk_log_size":3349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51299121,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":38,"num_read":12130,"num_read_kb":27934,"num_write":2245,"num_write_kb":1738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":719,"num_flush":173,"num_flush_kb":6205,"num_evict":482,"num_evict_kb":39117,"num_promote":533,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"153'1364","reported_seq":2318,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:55.328086+0000","last_change":"2023-12-06T15:30:17.614750+0000","last_active":"2023-12-06T16:28:55.328086+0000","last_peered":"2023-12-06T16:28:55.328086+0000","last_clean":"2023-12-06T16:28:55.328086+0000","last_became_active":"2023-12-06T15:25:48.204290+0000","last_became_peered":"2023-12-06T15:25:48.204290+0000","last_unstale":"2023-12-06T16:28:55.328086+0000","last_undegraded":"2023-12-06T16:28:55.328086+0000","last_fullsized":"2023-12-06T16:28:55.328086+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":1364,"ondisk_log_size":1364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":73011320,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":688,"num_read_kb":4922,"num_write":819,"num_write_kb":1094364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"153'3641","reported_seq":9475,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728910+0000","last_change":"2023-12-06T15:30:17.620567+0000","last_active":"2023-12-06T16:28:53.728910+0000","last_peered":"2023-12-06T16:28:53.728910+0000","last_clean":"2023-12-06T16:28:53.728910+0000","last_became_active":"2023-12-06T15:25:54.223136+0000","last_became_peered":"2023-12-06T15:25:54.223136+0000","last_unstale":"2023-12-06T16:28:53.728910+0000","last_undegraded":"2023-12-06T16:28:53.728910+0000","last_fullsized":"2023-12-06T16:28:53.728910+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":3641,"ondisk_log_size":3641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11076424,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":42,"num_read":10502,"num_read_kb":28911,"num_write":1839,"num_write_kb":767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":805,"num_flush":189,"num_flush_kb":1977,"num_evict":486,"num_evict_kb":35620,"num_promote":533,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":150,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728781+0000","last_change":"2023-12-06T15:25:48.207167+0000","last_active":"2023-12-06T16:28:53.728781+0000","last_peered":"2023-12-06T16:28:53.728781+0000","last_clean":"2023-12-06T16:28:53.728781+0000","last_became_active":"2023-12-06T15:25:48.206870+0000","last_became_peered":"2023-12-06T15:25:48.206870+0000","last_unstale":"2023-12-06T16:28:53.728781+0000","last_undegraded":"2023-12-06T16:28:53.728781+0000","last_fullsized":"2023-12-06T16:28:53.728781+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"153'1386","reported_seq":2258,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729136+0000","last_change":"2023-12-06T15:30:17.616899+0000","last_active":"2023-12-06T16:28:53.729136+0000","last_peered":"2023-12-06T16:28:53.729136+0000","last_clean":"2023-12-06T16:28:53.729136+0000","last_became_active":"2023-12-06T15:25:48.205750+0000","last_became_peered":"2023-12-06T15:25:48.205750+0000","last_unstale":"2023-12-06T16:28:53.729136+0000","last_undegraded":"2023-12-06T16:28:53.729136+0000","last_fullsized":"2023-12-06T16:28:53.729136+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":1386,"ondisk_log_size":1386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":91811925,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":601,"num_read_kb":4028,"num_write":820,"num_write_kb":1199092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"153'6456","reported_seq":14785,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728858+0000","last_change":"2023-12-06T15:30:17.621570+0000","last_active":"2023-12-06T16:28:53.728858+0000","last_peered":"2023-12-06T16:28:53.728858+0000","last_clean":"2023-12-06T16:28:53.728858+0000","last_became_active":"2023-12-06T15:25:54.221489+0000","last_became_peered":"2023-12-06T15:25:54.221489+0000","last_unstale":"2023-12-06T16:28:53.728858+0000","last_undegraded":"2023-12-06T16:28:53.728858+0000","last_fullsized":"2023-12-06T16:28:53.728858+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":6456,"ondisk_log_size":6456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":42890638,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":35,"num_read":24199,"num_read_kb":36879,"num_write":5231,"num_write_kb":3994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1414,"num_flush":231,"num_flush_kb":8685,"num_evict":509,"num_evict_kb":32296,"num_promote":556,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"153'887","reported_seq":1765,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:55.328085+0000","last_change":"2023-12-06T15:30:17.614745+0000","last_active":"2023-12-06T16:28:55.328085+0000","last_peered":"2023-12-06T16:28:55.328085+0000","last_clean":"2023-12-06T16:28:55.328085+0000","last_became_active":"2023-12-06T15:25:48.205967+0000","last_became_peered":"2023-12-06T15:25:48.205967+0000","last_unstale":"2023-12-06T16:28:55.328085+0000","last_undegraded":"2023-12-06T16:28:55.328085+0000","last_fullsized":"2023-12-06T16:28:55.328085+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":887,"ondisk_log_size":887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":113639590,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":664,"num_read_kb":403,"num_write":770,"num_write_kb":1081998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"153'4090","reported_seq":11085,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728527+0000","last_change":"2023-12-06T15:30:17.622674+0000","last_active":"2023-12-06T16:28:53.728527+0000","last_peered":"2023-12-06T16:28:53.728527+0000","last_clean":"2023-12-06T16:28:53.728527+0000","last_became_active":"2023-12-06T15:25:54.221304+0000","last_became_peered":"2023-12-06T15:25:54.221304+0000","last_unstale":"2023-12-06T16:28:53.728527+0000","last_undegraded":"2023-12-06T16:28:53.728527+0000","last_fullsized":"2023-12-06T16:28:53.728527+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":4090,"ondisk_log_size":4090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":41243290,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":40,"num_read":13526,"num_read_kb":30612,"num_write":2847,"num_write_kb":2055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":666,"num_flush":206,"num_flush_kb":5227,"num_evict":428,"num_evict_kb":30690,"num_promote":479,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"153'1069","reported_seq":1936,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728491+0000","last_change":"2023-12-06T15:30:17.621662+0000","last_active":"2023-12-06T16:28:53.728491+0000","last_peered":"2023-12-06T16:28:53.728491+0000","last_clean":"2023-12-06T16:28:53.728491+0000","last_became_active":"2023-12-06T15:25:48.204147+0000","last_became_peered":"2023-12-06T15:25:48.204147+0000","last_unstale":"2023-12-06T16:28:53.728491+0000","last_undegraded":"2023-12-06T16:28:53.728491+0000","last_fullsized":"2023-12-06T16:28:53.728491+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":1069,"ondisk_log_size":1069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127537306,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":556,"num_read_kb":811,"num_write":921,"num_write_kb":1173359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"153'871","reported_seq":1776,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728908+0000","last_change":"2023-12-06T15:30:17.620795+0000","last_active":"2023-12-06T16:28:53.728908+0000","last_peered":"2023-12-06T16:28:53.728908+0000","last_clean":"2023-12-06T16:28:53.728908+0000","last_became_active":"2023-12-06T15:25:48.204913+0000","last_became_peered":"2023-12-06T15:25:48.204913+0000","last_unstale":"2023-12-06T16:28:53.728908+0000","last_undegraded":"2023-12-06T16:28:53.728908+0000","last_fullsized":"2023-12-06T16:28:53.728908+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":871,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":43483484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":604,"num_read_kb":608,"num_write":703,"num_write_kb":1043763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":146509473,"num_objects":216,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":155,"num_read":60357,"num_read_kb":124336,"num_write":12162,"num_write_kb":8554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":16,"num_bytes_hit_set_archive":3604,"num_flush":799,"num_flush_kb":22094,"num_evict":1905,"num_evict_kb":137723,"num_promote":2101,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":187801600,"data_stored":187645250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17536,"ondisk_log_size":17536,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":644057897,"num_objects":264,"num_object_clones":2,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264,"num_whiteouts":2,"num_read":5281,"num_read_kb":19002,"num_write":6262,"num_write_kb":8828450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":271777792,"data_stored":271513170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8203,"ondisk_log_size":8203,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740569,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":444440,"kb_used_data":134928,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93927400,"statfs":{"total":96636764160,"available":96181657600,"internally_reserved":0,"allocated":138166272,"data_stored":137425212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 18:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.23200000000000001,"5min":0.23300000000000001,"15min":0.22600000000000001},"min":{"1min":0.17799999999999999,"5min":0.155,"15min":0.14099999999999999},"max":{"1min":0.42299999999999999,"5min":0.441,"15min":0.48699999999999999},"last":0.218},{"interface":"front","average":{"1min":0.249,"5min":0.24299999999999999,"15min":0.23400000000000001},"min":{"1min":0.20000000000000001,"5min":0.17000000000000001,"15min":0.16300000000000001},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.46100000000000002},"last":0.247}]},{"osd":1,"last update":"Wed Dec 6 18:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.251,"5min":0.251,"15min":0.246},"min":{"1min":0.188,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.48799999999999999},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.27900000000000003,"15min":0.27200000000000002},"min":{"1min":0.23599999999999999,"5min":0.19800000000000001,"15min":0.17100000000000001},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.28599999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740568,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":468184,"kb_used_data":158672,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93903656,"statfs":{"total":96636764160,"available":96157343744,"internally_reserved":0,"allocated":162480128,"data_stored":161733705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 18:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.23000000000000001,"5min":0.215,"15min":0.215},"min":{"1min":0.154,"5min":0.14399999999999999,"15min":0.13200000000000001},"max":{"1min":0.38900000000000001,"5min":0.434,"15min":0.45000000000000001},"last":0.14699999999999999},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.25700000000000001,"15min":0.247},"min":{"1min":0.21199999999999999,"5min":0.159,"15min":0.155},"max":{"1min":0.439,"5min":0.439,"15min":0.47099999999999997},"last":0.20100000000000001}]},{"osd":2,"last update":"Wed Dec 6 18:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.248,"5min":0.22600000000000001,"15min":0.22700000000000001},"min":{"1min":0.17799999999999999,"5min":0.16800000000000001,"15min":0.152},"max":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.47899999999999998},"last":0.17599999999999999},{"interface":"front","average":{"1min":0.255,"5min":0.23699999999999999,"15min":0.24099999999999999},"min":{"1min":0.186,"5min":0.185,"15min":0.17399999999999999},"max":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.48399999999999999},"last":0.218}]}]},{"osd":1,"up_from":8,"seq":34359740568,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":468580,"kb_used_data":159068,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93903260,"statfs":{"total":96636764160,"available":96156938240,"internally_reserved":0,"allocated":162885632,"data_stored":162075943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 18:28:01 2023","interfaces":[{"interface":"back","average":{"1min":0.19900000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"min":{"1min":0.13600000000000001,"5min":0.13600000000000001,"15min":0.13600000000000001},"max":{"1min":0.35699999999999998,"5min":0.46600000000000003,"15min":0.48599999999999999},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.25800000000000001,"5min":0.26700000000000002,"15min":0.26800000000000002},"min":{"1min":0.19900000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.433,"5min":0.48699999999999999,"15min":0.504},"last":0.255}]},{"osd":2,"last update":"Wed Dec 6 18:28:01 2023","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.46000000000000002},"last":0.19700000000000001},{"interface":"front","average":{"1min":0.23799999999999999,"5min":0.24299999999999999,"15min":0.24399999999999999},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.214}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":92942336,"data_stored":92846518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":135888896,"data_stored":135756585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":42946560,"data_stored":42910067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68222976,"data_stored":68195787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25677824,"data_stored":25626838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":93900800,"data_stored":93822625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T18:28:45.903 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-06T18:28:46.212 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T18:28:46.213 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":156,"fsid":"d9839fb7-f14a-4da0-b485-65c61122611f","created":"2023-12-06T15:25:38.200058+0000","modified":"2023-12-06T16:28:58.726896+0000","last_up_change":"2023-12-06T15:25:46.189008+0000","last_in_change":"2023-12-06T15:25:39.179248+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-06T15:25:46.228677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-06T15:25:46.870005+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"15","last_force_op_resend_prenautilus":"15","last_force_op_resend_preluminous":"15","auid":0,"snap_mode":"selfmanaged","snap_seq":91,"snap_epoch":151,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[3],"tier_of":-1,"read_tier":3,"write_tier":3,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cache","create_time":"2023-12-06T15:25:53.092415+0000","flags":8201,"flags_names":"hashpspool,incomplete_clones,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"15","last_force_op_resend_prenautilus":"15","last_force_op_resend_preluminous":"15","auid":0,"snap_mode":"selfmanaged","snap_seq":91,"snap_epoch":151,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":2,"read_tier":-1,"write_tier":-1,"cache_mode":"writeback","target_max_bytes":0,"target_max_objects":250,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"bloom","false_positive_probability":0.050000000000000003,"target_size":0,"seed":0},"hit_set_period":60,"hit_set_count":8,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"8aca3223-ca02-4768-8194-522c80e4cab0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":114439},{"type":"v1","addr":"172.21.15.123:6801","nonce":114439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":114439},{"type":"v1","addr":"172.21.15.123:6803","nonce":114439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":114439},{"type":"v1","addr":"172.21.15.123:6807","nonce":114439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":114439},{"type":"v1","addr":"172.21.15.123:6805","nonce":114439}]},"public_addr":"172.21.15.123:6801/114439","cluster_addr":"172.21.15.123:6803/114439","heartbeat_back_addr":"172.21.15.123:6807/114439","heartbeat_front_addr":"172.21.15.123:6805/114439","state":["exists","up"]},{"osd":1,"uuid":"00bd97ad-a075-4a29-8402-47a59cafeaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":114455},{"type":"v1","addr":"172.21.15.123:6817","nonce":114455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":114455},{"type":"v1","addr":"172.21.15.123:6819","nonce":114455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":114455},{"type":"v1","addr":"172.21.15.123:6823","nonce":114455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":114455},{"type":"v1","addr":"172.21.15.123:6821","nonce":114455}]},"public_addr":"172.21.15.123:6817/114455","cluster_addr":"172.21.15.123:6819/114455","heartbeat_back_addr":"172.21.15.123:6823/114455","heartbeat_front_addr":"172.21.15.123:6821/114455","state":["exists","up"]},{"osd":2,"uuid":"022162d6-8d34-40d4-8386-8c2eaa3880d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":114440},{"type":"v1","addr":"172.21.15.123:6809","nonce":114440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":114440},{"type":"v1","addr":"172.21.15.123:6811","nonce":114440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":114440},{"type":"v1","addr":"172.21.15.123:6815","nonce":114440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":114440},{"type":"v1","addr":"172.21.15.123:6813","nonce":114440}]},"public_addr":"172.21.15.123:6809/114440","cluster_addr":"172.21.15.123:6811/114440","heartbeat_back_addr":"172.21.15.123:6815/114440","heartbeat_front_addr":"172.21.15.123:6813/114440","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T15:25:44.297358+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T15:25:44.369755+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T15:25:44.324521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":4,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]},{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]},{"pool":6,"snaps":[{"begin":4,"length":1}]},{"pool":7,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-06T18:28:46.488 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:46.484+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:46.790 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:46.787+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:47.227 INFO:tasks.ceph:Scrubbing osd.0 2023-12-06T18:28:47.228 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-06T18:28:47.521 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:47.518+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:47.752 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:47.748+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:48.506 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:48.503+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:48.750 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:48.747+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:49.522 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:49.519+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:49.738 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:49.735+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:50.543 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:50.540+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:50.692 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:50.689+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:51.584 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:51.581+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:51.708 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:51.705+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:52.594 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:52.591+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:52.697 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:52.693+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:53.614 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:53.611+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:53.732 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:53.729+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:54.570 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:54.563+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:54.763 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:54.759+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:55.534 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:55.531+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:55.782 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:55.779+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:56.500 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:56.497+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:56.742 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:56.739+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:57.453 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:57.449+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:57.709 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:57.704+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:58.432 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:58.428+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:58.743 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:58.738+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:28:59.412 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:28:59.408+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:28:59.708 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:28:59.704+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:00.434 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:00.429+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:00.715 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:00.710+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:01.400 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:01.395+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:01.713 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:01.709+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:02.374 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:02.370+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:02.746 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:02.741+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:03.337 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:03.333+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:03.786 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:03.782+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:04.320 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:04.316+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:04.762 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:04.758+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:05.318 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:05.314+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:05.720 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:05.716+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:06.291 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:06.288+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:06.764 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:06.761+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:07.284 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:07.281+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:07.800 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:07.797+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:08.306 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:08.303+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:08.838 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:08.835+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:09.280 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:09.277+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:09.816 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:09.813+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:10.301 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:10.298+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:10.855 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:10.852+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:11.348 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:11.345+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:11.822 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:11.818+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:12.362 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:12.359+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:12.787 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:12.784+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:13.353 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:13.349+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:13.775 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:13.772+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:14.348 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:14.345+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:14.731 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:14.727+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:15.343 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:15.340+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:15.734 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:15.731+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:16.362 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:16.359+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:16.776 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:16.773+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:17.358 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:17.355+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:17.826 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:17.823+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:18.316 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:18.313+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:18.816 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:18.813+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:19.278 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:19.275+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:19.861 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:19.858+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:20.276 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:20.272+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:20.887 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:20.884+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:21.238 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:21.235+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:21.930 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:21.926+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:22.199 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:22.195+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:22.935 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:22.932+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:23.242 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:23.239+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:23.968 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:23.965+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:24.271 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:24.268+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:24.966 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:24.963+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:25.281 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:25.277+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:25.993 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:25.990+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:26.270 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:26.267+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:27.008 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:27.005+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:27.299 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:27.296+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:28.001 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:27.997+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:28.307 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:28.304+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:29.024 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:29.021+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:29.320 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:29.317+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:29.985 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:29.982+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:30.321 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:30.318+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:31.005 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:31.002+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:31.279 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:31.276+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:32.055 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:32.052+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:32.261 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:32.258+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:33.017 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:33.014+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:33.233 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:33.230+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:34.020 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:34.016+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:34.250 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:34.247+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:35.003 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:35.000+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:35.278 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:35.275+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:36.050 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:36.047+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:36.286 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:36.283+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:37.008 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:37.005+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:37.315 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:37.312+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:37.982 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:37.978+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:38.286 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:38.283+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:38.982 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:38.979+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:39.317 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:39.314+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:39.953 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:39.948+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:40.362 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:40.358+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:40.940 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:40.936+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:41.331 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:41.327+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:41.976 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:41.971+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:42.317 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:42.313+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:42.953 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:42.949+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:43.273 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:43.269+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:43.974 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:43.970+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:44.314 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:44.310+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:44.968 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:44.963+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:45.325 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:45.321+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:46.016 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:46.012+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:46.358 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:46.354+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:46.972 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:46.967+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:47.382 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:47.378+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:47.997 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:47.993+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:48.406 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:48.402+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:49.012 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:49.009+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:49.414 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:49.410+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:50.058 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:50.054+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:50.407 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:50.404+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:51.096 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:51.093+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:51.445 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:51.442+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:52.086 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:52.082+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:52.488 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:52.484+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:53.038 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:53.035+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:53.449 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:53.446+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:54.055 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:54.052+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:54.424 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:54.421+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:55.074 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:55.071+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:55.391 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:55.387+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:56.058 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:56.054+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:56.402 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:56.399+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:57.099 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:57.096+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:57.370 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:57.367+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:58.105 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:58.102+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:58.415 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:58.412+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:29:59.088 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:29:59.085+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:29:59.449 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:29:59.446+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:00.118 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:00.115+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:00.403 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:00.399+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:01.138 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:01.135+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:01.429 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:01.425+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:02.177 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:02.173+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:02.388 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:02.385+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:03.166 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:03.162+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:03.382 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:03.379+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:04.158 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:04.155+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:04.348 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:04.345+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:05.206 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:05.199+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:05.396 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:05.393+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:06.207 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:06.204+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:06.360 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:06.357+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:07.182 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:07.179+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:07.343 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:07.340+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:08.159 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:08.156+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:08.352 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:08.349+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:09.154 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:09.151+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:09.389 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:09.386+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:10.185 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:10.182+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:10.429 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:10.425+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:11.173 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:11.169+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:11.426 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:11.423+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:12.124 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:12.120+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:12.470 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:12.467+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:13.146 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:13.142+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:13.426 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:13.423+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:14.157 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:14.153+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:14.466 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:14.463+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:15.203 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:15.200+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:15.440 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:15.437+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:16.178 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:16.174+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:16.438 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:16.435+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:17.166 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:17.163+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:17.428 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:17.425+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:18.194 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:18.191+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:18.412 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:18.409+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:19.211 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:19.208+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:19.391 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:19.388+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:20.178 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:20.175+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:20.378 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:20.375+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:21.175 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:21.172+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:21.375 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:21.372+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:22.140 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:22.137+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:22.393 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:22.389+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:23.124 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:23.120+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:23.365 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:23.361+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:24.164 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:24.159+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:24.380 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:24.376+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:25.188 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:25.183+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:25.363 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:25.359+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:26.223 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:26.218+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:26.383 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:26.379+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:27.191 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:27.187+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:27.387 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:27.383+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:28.164 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:28.160+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:28.380 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:28.376+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:29.166 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:29.162+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:29.376 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:29.372+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:30.187 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:30.183+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:30.411 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:30.407+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:31.158 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:31.153+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:31.433 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:31.428+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:32.120 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:32.117+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:32.423 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:32.420+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:33.166 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:33.163+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:33.403 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:33.400+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:34.182 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:34.179+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:34.374 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:34.371+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:35.188 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:35.185+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:35.341 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:35.337+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:36.218 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:36.215+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:36.308 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:36.305+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:37.246 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:37.243+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:37.288 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:37.285+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:38.251 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:38.248+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:38.275 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:38.271+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:39.245 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:39.242+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:39.310 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:39.307+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:40.270 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:40.267+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:40.280 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:40.277+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:41.223 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:41.220+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:41.285 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:41.279+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:42.214 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:42.211+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:42.270 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:42.267+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:43.208 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:43.204+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:43.225 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:43.222+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:44.238 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:44.234+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:44.250 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:44.247+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:45.230 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:45.226+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:45.272 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:45.269+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:46.200 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:46.197+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:46.322 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:46.319+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:47.157 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:47.153+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:47.259 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-12-06T18:30:47.260 INFO:tasks.ceph:Scrubbing osd.1 2023-12-06T18:30:47.260 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-06T18:30:47.319 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:47.315+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:48.189 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:48.185+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:48.369 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:48.365+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:49.191 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:49.187+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:49.412 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:49.409+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:50.229 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:50.226+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:50.430 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:50.427+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:51.215 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:51.212+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:51.433 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:51.430+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:52.219 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:52.215+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:52.407 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:52.404+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:53.238 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:53.235+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:53.416 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:53.413+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:54.258 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:54.255+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:54.385 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:54.382+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:55.239 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:55.236+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:55.426 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:55.423+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:56.272 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:56.269+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:56.434 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:56.431+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:57.281 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:57.278+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:57.428 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:57.425+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:58.314 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:58.311+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:58.419 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:58.415+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:30:59.314 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:30:59.311+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:30:59.397 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:30:59.394+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:00.315 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:00.311+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:00.372 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:00.369+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:01.292 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:01.289+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:01.401 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:01.398+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:02.270 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:02.267+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:02.399 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:02.396+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:03.282 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:03.278+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:03.386 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:03.383+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:04.266 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:04.263+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:04.405 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:04.402+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:05.253 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:05.249+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:05.361 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:05.357+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:06.243 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:06.239+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:06.406 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:06.402+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:07.237 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:07.233+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:07.382 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:07.377+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:08.228 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:08.224+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:08.363 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:08.359+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:09.188 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:09.184+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:09.328 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:09.324+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:10.146 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:10.142+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:10.308 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:10.304+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:11.186 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:11.182+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:11.300 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:11.296+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:12.236 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:12.232+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:12.281 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:12.277+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:13.226 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:13.222+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:13.234 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:13.230+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:14.211 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:14.208+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:14.212 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:14.208+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:15.250 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:15.246+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:15.262 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:15.259+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:16.232 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:16.229+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:16.254 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:16.251+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:17.223 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:17.220+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:17.253 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:17.249+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:18.191 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:18.187+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:18.244 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:18.241+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:19.192 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:19.188+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:19.293 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:19.290+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:20.193 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:20.190+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:20.307 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:20.303+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:21.200 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:21.197+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:21.304 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:21.301+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:22.235 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:22.232+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:22.263 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:22.260+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:23.211 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:23.208+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:23.294 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:23.291+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:24.176 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:24.173+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:24.291 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:24.288+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:25.224 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:25.220+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:25.330 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:25.327+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:26.192 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:26.189+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:26.374 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:26.371+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:27.226 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:27.223+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:27.343 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:27.340+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:28.274 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:28.271+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:28.330 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:28.327+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:29.297 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:29.294+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:29.298 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:29.295+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:30.316 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:30.313+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:30.317 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:30.314+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:31.286 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:31.283+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:31.329 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:31.326+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:32.250 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:32.247+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:32.366 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:32.363+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:33.208 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:33.204+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:33.402 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:33.399+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:34.252 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:34.249+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:34.354 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:34.351+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:35.270 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:35.267+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:35.397 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:35.394+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:36.234 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:36.230+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:36.408 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:36.405+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:37.219 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:37.216+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:37.441 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:37.437+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:38.253 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:38.250+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:38.404 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:38.401+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:39.304 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:39.300+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:39.388 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:39.385+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:40.319 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:40.316+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:40.392 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:40.389+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:41.360 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:41.357+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:41.364 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:41.361+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:42.317 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:42.314+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:42.364 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:42.361+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:43.272 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:43.269+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:43.362 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:43.358+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:44.314 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:44.311+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:44.336 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:44.333+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:45.315 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:45.312+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:45.352 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:45.349+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:46.310 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:46.307+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:46.360 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:46.357+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:47.350 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:47.347+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:47.358 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:47.355+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:48.334 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:48.330+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:48.394 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:48.390+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:49.305 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:49.300+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:49.396 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:49.392+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:50.339 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:50.335+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:50.395 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:50.391+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:51.331 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:51.327+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:51.423 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:51.419+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:52.356 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:52.351+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:52.417 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:52.413+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:53.384 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:53.380+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:53.404 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:53.400+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:54.414 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:54.409+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:54.430 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:54.426+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:55.453 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:55.450+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:55.468 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:55.464+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:56.428 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:56.423+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:56.504 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:56.500+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:57.379 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:57.376+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:57.504 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:57.501+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:58.383 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:58.380+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:58.493 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:58.489+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:31:59.394 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:31:59.391+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:31:59.500 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:31:59.497+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:00.441 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:00.437+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:00.528 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:00.525+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:01.414 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:01.411+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:01.553 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:01.550+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:02.403 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:02.400+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:02.519 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:02.516+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:03.359 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:03.356+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:03.558 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:03.555+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:04.337 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:04.334+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:04.567 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:04.564+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:05.353 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:05.350+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:05.545 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:05.542+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:06.401 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:06.398+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:06.499 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:06.496+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:07.422 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:07.419+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:07.469 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:07.466+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:08.443 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:08.440+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:08.453 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:08.450+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:09.446 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:09.443+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:09.497 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:09.494+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:10.449 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:10.446+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:10.495 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:10.492+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:11.449 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:11.445+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:11.535 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:11.532+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:12.427 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:12.424+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:12.488 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:12.485+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:13.451 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:13.447+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:13.493 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:13.490+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:14.441 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:14.438+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:14.516 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:14.513+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:15.451 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:15.447+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:15.547 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:15.544+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:16.474 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:16.471+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:16.532 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:16.529+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:17.439 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:17.436+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:17.491 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:17.488+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:18.430 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:18.427+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:18.492 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:18.489+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:19.467 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:19.463+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:19.534 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:19.531+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:20.444 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:20.441+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:20.492 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:20.489+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:21.463 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:21.459+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:21.517 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:21.514+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:22.466 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:22.462+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:22.513 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:22.510+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:23.456 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:23.453+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:23.484 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:23.481+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:24.440 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:24.437+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:24.502 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:24.499+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:25.396 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:25.393+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:25.475 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:25.472+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:26.382 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:26.379+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:26.431 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:26.428+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:27.356 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:27.353+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:27.441 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:27.438+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:28.377 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:28.373+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:28.483 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:28.480+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:29.370 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:29.367+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:29.532 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:29.529+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:30.388 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:30.385+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:30.561 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:30.557+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:31.356 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:31.351+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:31.545 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:31.541+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:32.367 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:32.363+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:32.511 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:32.507+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:33.376 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:33.372+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:33.547 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:33.543+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:34.353 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:34.349+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:34.512 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:34.508+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:35.377 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:35.373+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:35.552 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:35.548+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:36.357 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:36.353+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:36.539 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:36.535+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:37.398 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:37.394+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:37.587 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:37.582+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:38.359 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:38.355+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:38.564 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:38.560+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:39.391 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:39.387+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:39.548 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:39.545+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:40.376 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:40.373+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:40.584 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:40.581+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:41.357 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:41.354+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:41.587 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:41.584+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:42.358 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:42.355+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:42.611 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:42.607+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:43.376 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:43.373+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:43.634 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:43.631+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:44.356 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:44.353+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:44.598 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:44.595+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:45.310 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:45.307+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:45.580 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:45.577+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:46.280 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:46.277+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:46.616 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:46.612+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:47.292 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-12-06T18:32:47.293 INFO:tasks.ceph:Scrubbing osd.2 2023-12-06T18:32:47.293 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-06T18:32:47.314 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:47.311+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:47.455 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2023-12-06T18:32:47.455 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-06T18:32:47.456 INFO:teuthology.orchestra.run.smithi123.stdout:} 2023-12-06T18:32:47.468 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-06T18:32:47.664 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:47.661+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:47.824 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 2 to deep-scrub 2023-12-06T18:32:47.836 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T18:32:48.156 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T18:32:48.158 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2023-12-06T18:32:48.168 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":5763,"stamp":"2023-12-06T18:32:46.797177+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":790567370,"num_objects":480,"num_object_clones":2,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":385,"num_whiteouts":157,"num_read":65638,"num_read_kb":143338,"num_write":18424,"num_write_kb":8837004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":16,"num_bytes_hit_set_archive":3604,"num_flush":799,"num_flush_kb":22094,"num_evict":1905,"num_evict_kb":137723,"num_promote":2101,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25739,"ondisk_log_size":25739,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1381204,"kb_used_data":452668,"kb_used_omap":0,"kb_used_meta":928512,"kb_avail":281734316,"statfs":{"total":289910292480,"available":288495939584,"internally_reserved":0,"allocated":463532032,"data_stored":461234860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":950796288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002012"},"pg_stats":[{"pgid":"2.7","version":"153'998","reported_seq":1985,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729083+0000","last_change":"2023-12-06T15:30:17.617146+0000","last_active":"2023-12-06T16:28:53.729083+0000","last_peered":"2023-12-06T16:28:53.729083+0000","last_clean":"2023-12-06T16:28:53.729083+0000","last_became_active":"2023-12-06T15:25:48.206888+0000","last_became_peered":"2023-12-06T15:25:48.206888+0000","last_unstale":"2023-12-06T16:28:53.729083+0000","last_undegraded":"2023-12-06T16:28:53.729083+0000","last_fullsized":"2023-12-06T16:28:53.729083+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":998,"ondisk_log_size":998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":106983625,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":814,"num_read_kb":2793,"num_write":872,"num_write_kb":1182412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"153'847","reported_seq":1720,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729016+0000","last_change":"2023-12-06T15:30:17.617250+0000","last_active":"2023-12-06T16:28:53.729016+0000","last_peered":"2023-12-06T16:28:53.729016+0000","last_clean":"2023-12-06T16:28:53.729016+0000","last_became_active":"2023-12-06T15:25:48.206986+0000","last_became_peered":"2023-12-06T15:25:48.206986+0000","last_unstale":"2023-12-06T16:28:53.729016+0000","last_undegraded":"2023-12-06T16:28:53.729016+0000","last_fullsized":"2023-12-06T16:28:53.729016+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":847,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":47205134,"num_objects":21,"num_object_clones":1,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":1,"num_read":583,"num_read_kb":897,"num_write":705,"num_write_kb":1089454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"153'781","reported_seq":1738,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728965+0000","last_change":"2023-12-06T15:30:17.617011+0000","last_active":"2023-12-06T16:28:53.728965+0000","last_peered":"2023-12-06T16:28:53.728965+0000","last_clean":"2023-12-06T16:28:53.728965+0000","last_became_active":"2023-12-06T15:25:48.206906+0000","last_became_peered":"2023-12-06T15:25:48.206906+0000","last_unstale":"2023-12-06T16:28:53.728965+0000","last_undegraded":"2023-12-06T16:28:53.728965+0000","last_fullsized":"2023-12-06T16:28:53.728965+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":781,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":40385513,"num_objects":26,"num_object_clones":1,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":771,"num_read_kb":4540,"num_write":652,"num_write_kb":964008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"153'3349","reported_seq":8242,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728490+0000","last_change":"2023-12-06T15:30:17.622402+0000","last_active":"2023-12-06T16:28:53.728490+0000","last_peered":"2023-12-06T16:28:53.728490+0000","last_clean":"2023-12-06T16:28:53.728490+0000","last_became_active":"2023-12-06T15:25:54.220756+0000","last_became_peered":"2023-12-06T15:25:54.220756+0000","last_unstale":"2023-12-06T16:28:53.728490+0000","last_undegraded":"2023-12-06T16:28:53.728490+0000","last_fullsized":"2023-12-06T16:28:53.728490+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":3349,"ondisk_log_size":3349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51299121,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":38,"num_read":12130,"num_read_kb":27934,"num_write":2245,"num_write_kb":1738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":719,"num_flush":173,"num_flush_kb":6205,"num_evict":482,"num_evict_kb":39117,"num_promote":533,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"153'1364","reported_seq":2318,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:55.328086+0000","last_change":"2023-12-06T15:30:17.614750+0000","last_active":"2023-12-06T16:28:55.328086+0000","last_peered":"2023-12-06T16:28:55.328086+0000","last_clean":"2023-12-06T16:28:55.328086+0000","last_became_active":"2023-12-06T15:25:48.204290+0000","last_became_peered":"2023-12-06T15:25:48.204290+0000","last_unstale":"2023-12-06T16:28:55.328086+0000","last_undegraded":"2023-12-06T16:28:55.328086+0000","last_fullsized":"2023-12-06T16:28:55.328086+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":1364,"ondisk_log_size":1364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":73011320,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":688,"num_read_kb":4922,"num_write":819,"num_write_kb":1094364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"153'3641","reported_seq":9475,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728910+0000","last_change":"2023-12-06T15:30:17.620567+0000","last_active":"2023-12-06T16:28:53.728910+0000","last_peered":"2023-12-06T16:28:53.728910+0000","last_clean":"2023-12-06T16:28:53.728910+0000","last_became_active":"2023-12-06T15:25:54.223136+0000","last_became_peered":"2023-12-06T15:25:54.223136+0000","last_unstale":"2023-12-06T16:28:53.728910+0000","last_undegraded":"2023-12-06T16:28:53.728910+0000","last_fullsized":"2023-12-06T16:28:53.728910+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":3641,"ondisk_log_size":3641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11076424,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":42,"num_read":10502,"num_read_kb":28911,"num_write":1839,"num_write_kb":767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":805,"num_flush":189,"num_flush_kb":1977,"num_evict":486,"num_evict_kb":35620,"num_promote":533,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":150,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728781+0000","last_change":"2023-12-06T15:25:48.207167+0000","last_active":"2023-12-06T16:28:53.728781+0000","last_peered":"2023-12-06T16:28:53.728781+0000","last_clean":"2023-12-06T16:28:53.728781+0000","last_became_active":"2023-12-06T15:25:48.206870+0000","last_became_peered":"2023-12-06T15:25:48.206870+0000","last_unstale":"2023-12-06T16:28:53.728781+0000","last_undegraded":"2023-12-06T16:28:53.728781+0000","last_fullsized":"2023-12-06T16:28:53.728781+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"153'1386","reported_seq":2258,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729136+0000","last_change":"2023-12-06T15:30:17.616899+0000","last_active":"2023-12-06T16:28:53.729136+0000","last_peered":"2023-12-06T16:28:53.729136+0000","last_clean":"2023-12-06T16:28:53.729136+0000","last_became_active":"2023-12-06T15:25:48.205750+0000","last_became_peered":"2023-12-06T15:25:48.205750+0000","last_unstale":"2023-12-06T16:28:53.729136+0000","last_undegraded":"2023-12-06T16:28:53.729136+0000","last_fullsized":"2023-12-06T16:28:53.729136+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":1386,"ondisk_log_size":1386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":91811925,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":601,"num_read_kb":4028,"num_write":820,"num_write_kb":1199092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"153'6456","reported_seq":14785,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728858+0000","last_change":"2023-12-06T15:30:17.621570+0000","last_active":"2023-12-06T16:28:53.728858+0000","last_peered":"2023-12-06T16:28:53.728858+0000","last_clean":"2023-12-06T16:28:53.728858+0000","last_became_active":"2023-12-06T15:25:54.221489+0000","last_became_peered":"2023-12-06T15:25:54.221489+0000","last_unstale":"2023-12-06T16:28:53.728858+0000","last_undegraded":"2023-12-06T16:28:53.728858+0000","last_fullsized":"2023-12-06T16:28:53.728858+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":6456,"ondisk_log_size":6456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":42890638,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":35,"num_read":24199,"num_read_kb":36879,"num_write":5231,"num_write_kb":3994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1414,"num_flush":231,"num_flush_kb":8685,"num_evict":509,"num_evict_kb":32296,"num_promote":556,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"153'887","reported_seq":1765,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:55.328085+0000","last_change":"2023-12-06T15:30:17.614745+0000","last_active":"2023-12-06T16:28:55.328085+0000","last_peered":"2023-12-06T16:28:55.328085+0000","last_clean":"2023-12-06T16:28:55.328085+0000","last_became_active":"2023-12-06T15:25:48.205967+0000","last_became_peered":"2023-12-06T15:25:48.205967+0000","last_unstale":"2023-12-06T16:28:55.328085+0000","last_undegraded":"2023-12-06T16:28:55.328085+0000","last_fullsized":"2023-12-06T16:28:55.328085+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":887,"ondisk_log_size":887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":113639590,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":664,"num_read_kb":403,"num_write":770,"num_write_kb":1081998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"153'4090","reported_seq":11085,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728527+0000","last_change":"2023-12-06T15:30:17.622674+0000","last_active":"2023-12-06T16:28:53.728527+0000","last_peered":"2023-12-06T16:28:53.728527+0000","last_clean":"2023-12-06T16:28:53.728527+0000","last_became_active":"2023-12-06T15:25:54.221304+0000","last_became_peered":"2023-12-06T15:25:54.221304+0000","last_unstale":"2023-12-06T16:28:53.728527+0000","last_undegraded":"2023-12-06T16:28:53.728527+0000","last_fullsized":"2023-12-06T16:28:53.728527+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":4090,"ondisk_log_size":4090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":41243290,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":40,"num_read":13526,"num_read_kb":30612,"num_write":2847,"num_write_kb":2055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":666,"num_flush":206,"num_flush_kb":5227,"num_evict":428,"num_evict_kb":30690,"num_promote":479,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"153'1069","reported_seq":1936,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728491+0000","last_change":"2023-12-06T15:30:17.621662+0000","last_active":"2023-12-06T16:28:53.728491+0000","last_peered":"2023-12-06T16:28:53.728491+0000","last_clean":"2023-12-06T16:28:53.728491+0000","last_became_active":"2023-12-06T15:25:48.204147+0000","last_became_peered":"2023-12-06T15:25:48.204147+0000","last_unstale":"2023-12-06T16:28:53.728491+0000","last_undegraded":"2023-12-06T16:28:53.728491+0000","last_fullsized":"2023-12-06T16:28:53.728491+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":1069,"ondisk_log_size":1069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127537306,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":556,"num_read_kb":811,"num_write":921,"num_write_kb":1173359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"153'871","reported_seq":1776,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728908+0000","last_change":"2023-12-06T15:30:17.620795+0000","last_active":"2023-12-06T16:28:53.728908+0000","last_peered":"2023-12-06T16:28:53.728908+0000","last_clean":"2023-12-06T16:28:53.728908+0000","last_became_active":"2023-12-06T15:25:48.204913+0000","last_became_peered":"2023-12-06T15:25:48.204913+0000","last_unstale":"2023-12-06T16:28:53.728908+0000","last_undegraded":"2023-12-06T16:28:53.728908+0000","last_fullsized":"2023-12-06T16:28:53.728908+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":871,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":43483484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":604,"num_read_kb":608,"num_write":703,"num_write_kb":1043763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":146509473,"num_objects":216,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":155,"num_read":60357,"num_read_kb":124336,"num_write":12162,"num_write_kb":8554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":16,"num_bytes_hit_set_archive":3604,"num_flush":799,"num_flush_kb":22094,"num_evict":1905,"num_evict_kb":137723,"num_promote":2101,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":187801600,"data_stored":187645250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17536,"ondisk_log_size":17536,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":644057897,"num_objects":264,"num_object_clones":2,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264,"num_whiteouts":2,"num_read":5281,"num_read_kb":19002,"num_write":6262,"num_write_kb":8828450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":271777792,"data_stored":271513170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8203,"ondisk_log_size":8203,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740618,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":444440,"kb_used_data":134928,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93927400,"statfs":{"total":96636764160,"available":96181657600,"internally_reserved":0,"allocated":138166272,"data_stored":137425212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 18:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.23799999999999999,"5min":0.23499999999999999,"15min":0.23000000000000001},"min":{"1min":0.13800000000000001,"5min":0.13800000000000001,"15min":0.13800000000000001},"max":{"1min":0.42399999999999999,"5min":0.42499999999999999,"15min":0.441},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.24099999999999999,"5min":0.24199999999999999,"15min":0.23599999999999999},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.16300000000000001},"max":{"1min":0.442,"5min":0.45200000000000001,"15min":0.46100000000000002},"last":0.19}]},{"osd":1,"last update":"Wed Dec 6 18:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.25700000000000001,"5min":0.25,"15min":0.247},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":0.45400000000000001,"5min":0.46700000000000003,"15min":0.48799999999999999},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.27300000000000002,"5min":0.27600000000000002,"15min":0.27400000000000002},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.47299999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.26000000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740617,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":468184,"kb_used_data":158672,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93903656,"statfs":{"total":96636764160,"available":96157343744,"internally_reserved":0,"allocated":162480128,"data_stored":161733705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 18:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.214},"min":{"1min":0.14499999999999999,"5min":0.14199999999999999,"15min":0.13200000000000001},"max":{"1min":0.36799999999999999,"5min":0.40600000000000003,"15min":0.45000000000000001},"last":0.156},{"interface":"front","average":{"1min":0.26900000000000002,"5min":0.26000000000000001,"15min":0.254},"min":{"1min":0.20899999999999999,"5min":0.16600000000000001,"15min":0.155},"max":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.46899999999999997},"last":0.22}]},{"osd":2,"last update":"Wed Dec 6 18:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.23400000000000001,"5min":0.22800000000000001,"15min":0.224},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.152},"max":{"1min":0.40999999999999998,"5min":0.41599999999999998,"15min":0.47799999999999998},"last":0.18099999999999999},{"interface":"front","average":{"1min":0.24399999999999999,"5min":0.23599999999999999,"15min":0.23699999999999999},"min":{"1min":0.17100000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.40200000000000002,"5min":0.42699999999999999,"15min":0.48399999999999999},"last":0.19500000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740616,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":468580,"kb_used_data":159068,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93903260,"statfs":{"total":96636764160,"available":96156938240,"internally_reserved":0,"allocated":162885632,"data_stored":162075943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 18:32:10 2023","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20499999999999999,"15min":0.21299999999999999},"min":{"1min":0.14000000000000001,"5min":0.13400000000000001,"15min":0.13400000000000001},"max":{"1min":0.38400000000000001,"5min":0.40999999999999998,"15min":0.48599999999999999},"last":0.17299999999999999},{"interface":"front","average":{"1min":0.26900000000000002,"5min":0.26300000000000001,"15min":0.27000000000000002},"min":{"1min":0.17999999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.44500000000000001,"5min":0.46800000000000003,"15min":0.504},"last":0.23599999999999999}]},{"osd":2,"last update":"Wed Dec 6 18:32:10 2023","interfaces":[{"interface":"back","average":{"1min":0.245,"5min":0.23599999999999999,"15min":0.23799999999999999},"min":{"1min":0.19600000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.41399999999999998,"5min":0.443,"15min":0.46000000000000002},"last":0.20999999999999999},{"interface":"front","average":{"1min":0.25600000000000001,"5min":0.247,"15min":0.248},"min":{"1min":0.183,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.43099999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.223}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":92942336,"data_stored":92846518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":135888896,"data_stored":135756585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":42946560,"data_stored":42910067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68222976,"data_stored":68195787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25677824,"data_stored":25626838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":93900800,"data_stored":93822625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T18:32:48.173 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:32:48.173 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:32:48.173 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:32:48.173 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:32:48.173 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:32:48.174 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:32:48.174 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:32:48.174 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:32:48.174 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:32:48.174 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:32:48.175 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:32:48.175 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:32:48.175 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:32:48.175 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T18:32:48.355 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:48.352+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:48.694 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:48.691+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:49.310 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:49.307+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:49.649 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:49.646+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:50.300 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:50.297+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:50.630 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:50.627+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:51.296 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:51.293+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:51.612 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:51.609+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:52.342 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:52.339+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:52.610 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:52.607+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:53.295 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:53.292+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:53.582 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:53.579+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:54.254 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:54.251+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:54.631 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:54.628+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:55.220 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:55.217+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:55.676 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:55.673+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:56.264 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:56.261+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:56.639 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:56.636+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:57.280 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:57.277+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:57.590 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:57.587+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:58.253 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:58.250+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:58.636 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:58.633+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:32:59.304 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:32:59.301+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:32:59.662 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:32:59.659+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:00.335 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:00.331+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:00.673 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:00.670+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:01.316 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:01.312+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:01.702 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:01.699+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:02.350 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:02.347+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:02.734 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:02.731+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:03.388 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:03.385+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:03.772 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:03.768+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:04.396 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:04.392+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:04.772 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:04.769+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:05.440 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:05.437+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:05.818 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:05.815+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:06.392 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:06.389+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:06.858 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:06.855+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:07.401 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:07.398+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:07.849 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:07.846+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:08.176 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T18:33:08.418 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:08.415+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:08.490 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T18:33:08.492 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2023-12-06T18:33:08.504 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":5773,"stamp":"2023-12-06T18:33:06.799990+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":790567370,"num_objects":480,"num_object_clones":2,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":385,"num_whiteouts":157,"num_read":65638,"num_read_kb":143338,"num_write":18424,"num_write_kb":8837004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":16,"num_bytes_hit_set_archive":3604,"num_flush":799,"num_flush_kb":22094,"num_evict":1905,"num_evict_kb":137723,"num_promote":2101,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25810,"ondisk_log_size":25810,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1381204,"kb_used_data":452668,"kb_used_omap":0,"kb_used_meta":928512,"kb_avail":281734316,"statfs":{"total":289910292480,"available":288495939584,"internally_reserved":0,"allocated":463532032,"data_stored":461234860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":950796288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001632"},"pg_stats":[{"pgid":"2.7","version":"153'998","reported_seq":1985,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729083+0000","last_change":"2023-12-06T15:30:17.617146+0000","last_active":"2023-12-06T16:28:53.729083+0000","last_peered":"2023-12-06T16:28:53.729083+0000","last_clean":"2023-12-06T16:28:53.729083+0000","last_became_active":"2023-12-06T15:25:48.206888+0000","last_became_peered":"2023-12-06T15:25:48.206888+0000","last_unstale":"2023-12-06T16:28:53.729083+0000","last_undegraded":"2023-12-06T16:28:53.729083+0000","last_fullsized":"2023-12-06T16:28:53.729083+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":998,"ondisk_log_size":998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":106983625,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":814,"num_read_kb":2793,"num_write":872,"num_write_kb":1182412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"153'847","reported_seq":1720,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729016+0000","last_change":"2023-12-06T15:30:17.617250+0000","last_active":"2023-12-06T16:28:53.729016+0000","last_peered":"2023-12-06T16:28:53.729016+0000","last_clean":"2023-12-06T16:28:53.729016+0000","last_became_active":"2023-12-06T15:25:48.206986+0000","last_became_peered":"2023-12-06T15:25:48.206986+0000","last_unstale":"2023-12-06T16:28:53.729016+0000","last_undegraded":"2023-12-06T16:28:53.729016+0000","last_fullsized":"2023-12-06T16:28:53.729016+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":847,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":47205134,"num_objects":21,"num_object_clones":1,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":1,"num_read":583,"num_read_kb":897,"num_write":705,"num_write_kb":1089454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"153'781","reported_seq":1738,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728965+0000","last_change":"2023-12-06T15:30:17.617011+0000","last_active":"2023-12-06T16:28:53.728965+0000","last_peered":"2023-12-06T16:28:53.728965+0000","last_clean":"2023-12-06T16:28:53.728965+0000","last_became_active":"2023-12-06T15:25:48.206906+0000","last_became_peered":"2023-12-06T15:25:48.206906+0000","last_unstale":"2023-12-06T16:28:53.728965+0000","last_undegraded":"2023-12-06T16:28:53.728965+0000","last_fullsized":"2023-12-06T16:28:53.728965+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":781,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":40385513,"num_objects":26,"num_object_clones":1,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":771,"num_read_kb":4540,"num_write":652,"num_write_kb":964008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"153'3349","reported_seq":8242,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728490+0000","last_change":"2023-12-06T15:30:17.622402+0000","last_active":"2023-12-06T16:28:53.728490+0000","last_peered":"2023-12-06T16:28:53.728490+0000","last_clean":"2023-12-06T16:28:53.728490+0000","last_became_active":"2023-12-06T15:25:54.220756+0000","last_became_peered":"2023-12-06T15:25:54.220756+0000","last_unstale":"2023-12-06T16:28:53.728490+0000","last_undegraded":"2023-12-06T16:28:53.728490+0000","last_fullsized":"2023-12-06T16:28:53.728490+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":3349,"ondisk_log_size":3349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51299121,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":38,"num_read":12130,"num_read_kb":27934,"num_write":2245,"num_write_kb":1738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":719,"num_flush":173,"num_flush_kb":6205,"num_evict":482,"num_evict_kb":39117,"num_promote":533,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"156'1396","reported_seq":2355,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:32:50.626766+0000","last_change":"2023-12-06T18:32:50.626766+0000","last_active":"2023-12-06T18:32:50.626766+0000","last_peered":"2023-12-06T18:32:50.626766+0000","last_clean":"2023-12-06T18:32:50.626766+0000","last_became_active":"2023-12-06T15:25:48.204290+0000","last_became_peered":"2023-12-06T15:25:48.204290+0000","last_unstale":"2023-12-06T18:32:50.626766+0000","last_undegraded":"2023-12-06T18:32:50.626766+0000","last_fullsized":"2023-12-06T18:32:50.626766+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'1396","last_scrub_stamp":"2023-12-06T18:32:50.626638+0000","last_deep_scrub":"156'1396","last_deep_scrub_stamp":"2023-12-06T18:32:50.626638+0000","last_clean_scrub_stamp":"2023-12-06T18:32:50.626638+0000","log_size":1396,"ondisk_log_size":1396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":73011320,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":688,"num_read_kb":4922,"num_write":819,"num_write_kb":1094364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"153'3641","reported_seq":9475,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728910+0000","last_change":"2023-12-06T15:30:17.620567+0000","last_active":"2023-12-06T16:28:53.728910+0000","last_peered":"2023-12-06T16:28:53.728910+0000","last_clean":"2023-12-06T16:28:53.728910+0000","last_became_active":"2023-12-06T15:25:54.223136+0000","last_became_peered":"2023-12-06T15:25:54.223136+0000","last_unstale":"2023-12-06T16:28:53.728910+0000","last_undegraded":"2023-12-06T16:28:53.728910+0000","last_fullsized":"2023-12-06T16:28:53.728910+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":3641,"ondisk_log_size":3641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11076424,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":42,"num_read":10502,"num_read_kb":28911,"num_write":1839,"num_write_kb":767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":805,"num_flush":189,"num_flush_kb":1977,"num_evict":486,"num_evict_kb":35620,"num_promote":533,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":150,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728781+0000","last_change":"2023-12-06T15:25:48.207167+0000","last_active":"2023-12-06T16:28:53.728781+0000","last_peered":"2023-12-06T16:28:53.728781+0000","last_clean":"2023-12-06T16:28:53.728781+0000","last_became_active":"2023-12-06T15:25:48.206870+0000","last_became_peered":"2023-12-06T15:25:48.206870+0000","last_unstale":"2023-12-06T16:28:53.728781+0000","last_undegraded":"2023-12-06T16:28:53.728781+0000","last_fullsized":"2023-12-06T16:28:53.728781+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"153'1386","reported_seq":2258,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729136+0000","last_change":"2023-12-06T15:30:17.616899+0000","last_active":"2023-12-06T16:28:53.729136+0000","last_peered":"2023-12-06T16:28:53.729136+0000","last_clean":"2023-12-06T16:28:53.729136+0000","last_became_active":"2023-12-06T15:25:48.205750+0000","last_became_peered":"2023-12-06T15:25:48.205750+0000","last_unstale":"2023-12-06T16:28:53.729136+0000","last_undegraded":"2023-12-06T16:28:53.729136+0000","last_fullsized":"2023-12-06T16:28:53.729136+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":1386,"ondisk_log_size":1386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":91811925,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":601,"num_read_kb":4028,"num_write":820,"num_write_kb":1199092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"153'6456","reported_seq":14785,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728858+0000","last_change":"2023-12-06T15:30:17.621570+0000","last_active":"2023-12-06T16:28:53.728858+0000","last_peered":"2023-12-06T16:28:53.728858+0000","last_clean":"2023-12-06T16:28:53.728858+0000","last_became_active":"2023-12-06T15:25:54.221489+0000","last_became_peered":"2023-12-06T15:25:54.221489+0000","last_unstale":"2023-12-06T16:28:53.728858+0000","last_undegraded":"2023-12-06T16:28:53.728858+0000","last_fullsized":"2023-12-06T16:28:53.728858+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":6456,"ondisk_log_size":6456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":42890638,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":35,"num_read":24199,"num_read_kb":36879,"num_write":5231,"num_write_kb":3994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1414,"num_flush":231,"num_flush_kb":8685,"num_evict":509,"num_evict_kb":32296,"num_promote":556,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"156'926","reported_seq":1809,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:32:57.697314+0000","last_change":"2023-12-06T18:32:57.697314+0000","last_active":"2023-12-06T18:32:57.697314+0000","last_peered":"2023-12-06T18:32:57.697314+0000","last_clean":"2023-12-06T18:32:57.697314+0000","last_became_active":"2023-12-06T15:25:48.205967+0000","last_became_peered":"2023-12-06T15:25:48.205967+0000","last_unstale":"2023-12-06T18:32:57.697314+0000","last_undegraded":"2023-12-06T18:32:57.697314+0000","last_fullsized":"2023-12-06T18:32:57.697314+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'926","last_scrub_stamp":"2023-12-06T18:32:57.697195+0000","last_deep_scrub":"156'926","last_deep_scrub_stamp":"2023-12-06T18:32:57.697195+0000","last_clean_scrub_stamp":"2023-12-06T18:32:57.697195+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":113639590,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":664,"num_read_kb":403,"num_write":770,"num_write_kb":1081998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"153'4090","reported_seq":11085,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728527+0000","last_change":"2023-12-06T15:30:17.622674+0000","last_active":"2023-12-06T16:28:53.728527+0000","last_peered":"2023-12-06T16:28:53.728527+0000","last_clean":"2023-12-06T16:28:53.728527+0000","last_became_active":"2023-12-06T15:25:54.221304+0000","last_became_peered":"2023-12-06T15:25:54.221304+0000","last_unstale":"2023-12-06T16:28:53.728527+0000","last_undegraded":"2023-12-06T16:28:53.728527+0000","last_fullsized":"2023-12-06T16:28:53.728527+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":4090,"ondisk_log_size":4090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":41243290,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":40,"num_read":13526,"num_read_kb":30612,"num_write":2847,"num_write_kb":2055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":666,"num_flush":206,"num_flush_kb":5227,"num_evict":428,"num_evict_kb":30690,"num_promote":479,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"153'1069","reported_seq":1936,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728491+0000","last_change":"2023-12-06T15:30:17.621662+0000","last_active":"2023-12-06T16:28:53.728491+0000","last_peered":"2023-12-06T16:28:53.728491+0000","last_clean":"2023-12-06T16:28:53.728491+0000","last_became_active":"2023-12-06T15:25:48.204147+0000","last_became_peered":"2023-12-06T15:25:48.204147+0000","last_unstale":"2023-12-06T16:28:53.728491+0000","last_undegraded":"2023-12-06T16:28:53.728491+0000","last_fullsized":"2023-12-06T16:28:53.728491+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":1069,"ondisk_log_size":1069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127537306,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":556,"num_read_kb":811,"num_write":921,"num_write_kb":1173359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"153'871","reported_seq":1776,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728908+0000","last_change":"2023-12-06T15:30:17.620795+0000","last_active":"2023-12-06T16:28:53.728908+0000","last_peered":"2023-12-06T16:28:53.728908+0000","last_clean":"2023-12-06T16:28:53.728908+0000","last_became_active":"2023-12-06T15:25:48.204913+0000","last_became_peered":"2023-12-06T15:25:48.204913+0000","last_unstale":"2023-12-06T16:28:53.728908+0000","last_undegraded":"2023-12-06T16:28:53.728908+0000","last_fullsized":"2023-12-06T16:28:53.728908+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":871,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":43483484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":604,"num_read_kb":608,"num_write":703,"num_write_kb":1043763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":146509473,"num_objects":216,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":155,"num_read":60357,"num_read_kb":124336,"num_write":12162,"num_write_kb":8554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":16,"num_bytes_hit_set_archive":3604,"num_flush":799,"num_flush_kb":22094,"num_evict":1905,"num_evict_kb":137723,"num_promote":2101,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":187801600,"data_stored":187645250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17536,"ondisk_log_size":17536,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":644057897,"num_objects":264,"num_object_clones":2,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264,"num_whiteouts":2,"num_read":5281,"num_read_kb":19002,"num_write":6262,"num_write_kb":8828450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":271777792,"data_stored":271513170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8274,"ondisk_log_size":8274,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740622,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":444440,"kb_used_data":134928,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93927400,"statfs":{"total":96636764160,"available":96181657600,"internally_reserved":0,"allocated":138166272,"data_stored":137425212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 18:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.224,"5min":0.23400000000000001,"15min":0.22900000000000001},"min":{"1min":0.16600000000000001,"5min":0.13800000000000001,"15min":0.13800000000000001},"max":{"1min":0.35599999999999998,"5min":0.42499999999999999,"15min":0.441},"last":0.20399999999999999},{"interface":"front","average":{"1min":0.23000000000000001,"5min":0.23799999999999999,"15min":0.23499999999999999},"min":{"1min":0.155,"5min":0.155,"15min":0.155},"max":{"1min":0.39000000000000001,"5min":0.442,"15min":0.46100000000000002},"last":0.252}]},{"osd":1,"last update":"Wed Dec 6 18:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.23999999999999999,"5min":0.248,"15min":0.247},"min":{"1min":0.16300000000000001,"5min":0.16,"15min":0.16},"max":{"1min":0.379,"5min":0.45400000000000001,"15min":0.48799999999999999},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.26600000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"min":{"1min":0.21099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.40400000000000003,"5min":0.47299999999999998,"15min":0.48899999999999999},"last":0.23699999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740621,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":468184,"kb_used_data":158672,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93903656,"statfs":{"total":96636764160,"available":96157343744,"internally_reserved":0,"allocated":162480128,"data_stored":161733705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 18:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.214},"min":{"1min":0.14499999999999999,"5min":0.14199999999999999,"15min":0.13200000000000001},"max":{"1min":0.36799999999999999,"5min":0.40600000000000003,"15min":0.45000000000000001},"last":0.17699999999999999},{"interface":"front","average":{"1min":0.26900000000000002,"5min":0.26000000000000001,"15min":0.254},"min":{"1min":0.20899999999999999,"5min":0.16600000000000001,"15min":0.155},"max":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.46899999999999997},"last":0.248}]},{"osd":2,"last update":"Wed Dec 6 18:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.23400000000000001,"5min":0.22800000000000001,"15min":0.224},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.152},"max":{"1min":0.40999999999999998,"5min":0.41599999999999998,"15min":0.47799999999999998},"last":0.22},{"interface":"front","average":{"1min":0.24399999999999999,"5min":0.23599999999999999,"15min":0.23699999999999999},"min":{"1min":0.17100000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.40200000000000002,"5min":0.42699999999999999,"15min":0.48399999999999999},"last":0.23100000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740621,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":468580,"kb_used_data":159068,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93903260,"statfs":{"total":96636764160,"available":96156938240,"internally_reserved":0,"allocated":162885632,"data_stored":162075943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 18:32:10 2023","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20499999999999999,"15min":0.21299999999999999},"min":{"1min":0.14000000000000001,"5min":0.13400000000000001,"15min":0.13400000000000001},"max":{"1min":0.38400000000000001,"5min":0.40999999999999998,"15min":0.48599999999999999},"last":0.14699999999999999},{"interface":"front","average":{"1min":0.26900000000000002,"5min":0.26300000000000001,"15min":0.27000000000000002},"min":{"1min":0.17999999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.44500000000000001,"5min":0.46800000000000003,"15min":0.504},"last":0.192}]},{"osd":2,"last update":"Wed Dec 6 18:32:10 2023","interfaces":[{"interface":"back","average":{"1min":0.245,"5min":0.23599999999999999,"15min":0.23799999999999999},"min":{"1min":0.19600000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.41399999999999998,"5min":0.443,"15min":0.46000000000000002},"last":0.219},{"interface":"front","average":{"1min":0.25600000000000001,"5min":0.247,"15min":0.248},"min":{"1min":0.183,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.43099999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.20399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":92942336,"data_stored":92846518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":135888896,"data_stored":135756585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":42946560,"data_stored":42910067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68222976,"data_stored":68195787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25677824,"data_stored":25626838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":93900800,"data_stored":93822625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T18:33:08.505 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:08.505 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:08.505 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:08.505 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:08.505 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:08.506 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:08.506 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:08.506 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:08.506 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:08.506 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:08.506 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:08.507 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T18:33:08.812 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:08.809+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:09.429 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:09.425+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:09.849 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:09.846+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:10.438 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:10.435+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:10.868 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:10.865+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:11.478 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:11.474+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:11.871 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:11.868+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:12.512 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:12.509+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:12.920 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:12.917+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:13.486 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:13.482+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:13.959 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:13.955+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:14.452 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:14.448+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:14.981 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:14.977+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:15.486 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:15.482+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:16.016 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:16.012+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:16.456 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:16.452+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:17.013 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:17.009+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:17.438 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:17.434+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:17.972 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:17.967+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:18.482 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:18.478+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:18.960 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:18.956+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:19.493 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:19.489+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:19.966 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:19.962+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:20.522 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:20.518+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:20.921 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:20.917+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:21.509 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:21.504+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:21.897 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:21.892+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:22.532 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:22.529+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:22.881 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:22.877+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:23.537 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:23.534+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:23.894 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:23.891+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:24.515 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:24.512+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:24.899 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:24.896+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:25.543 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:25.540+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:25.887 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:25.883+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:26.510 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:26.506+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:26.849 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:26.846+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:27.504 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:27.500+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:27.819 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:27.816+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:28.507 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T18:33:28.552 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:28.549+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:28.824 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T18:33:28.825 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:28.821+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:28.826 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2023-12-06T18:33:28.838 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":5784,"stamp":"2023-12-06T18:33:28.803119+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":790567370,"num_objects":480,"num_object_clones":2,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":385,"num_whiteouts":157,"num_read":65638,"num_read_kb":143338,"num_write":18424,"num_write_kb":8837004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":16,"num_bytes_hit_set_archive":3604,"num_flush":799,"num_flush_kb":22094,"num_evict":1905,"num_evict_kb":137723,"num_promote":2101,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25810,"ondisk_log_size":25810,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1381204,"kb_used_data":452668,"kb_used_omap":0,"kb_used_meta":928512,"kb_avail":281734316,"statfs":{"total":289910292480,"available":288495939584,"internally_reserved":0,"allocated":463532032,"data_stored":461234860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":950796288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001511"},"pg_stats":[{"pgid":"2.7","version":"153'998","reported_seq":1985,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729083+0000","last_change":"2023-12-06T15:30:17.617146+0000","last_active":"2023-12-06T16:28:53.729083+0000","last_peered":"2023-12-06T16:28:53.729083+0000","last_clean":"2023-12-06T16:28:53.729083+0000","last_became_active":"2023-12-06T15:25:48.206888+0000","last_became_peered":"2023-12-06T15:25:48.206888+0000","last_unstale":"2023-12-06T16:28:53.729083+0000","last_undegraded":"2023-12-06T16:28:53.729083+0000","last_fullsized":"2023-12-06T16:28:53.729083+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":998,"ondisk_log_size":998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":106983625,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":814,"num_read_kb":2793,"num_write":872,"num_write_kb":1182412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"153'847","reported_seq":1720,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729016+0000","last_change":"2023-12-06T15:30:17.617250+0000","last_active":"2023-12-06T16:28:53.729016+0000","last_peered":"2023-12-06T16:28:53.729016+0000","last_clean":"2023-12-06T16:28:53.729016+0000","last_became_active":"2023-12-06T15:25:48.206986+0000","last_became_peered":"2023-12-06T15:25:48.206986+0000","last_unstale":"2023-12-06T16:28:53.729016+0000","last_undegraded":"2023-12-06T16:28:53.729016+0000","last_fullsized":"2023-12-06T16:28:53.729016+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":847,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":47205134,"num_objects":21,"num_object_clones":1,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":1,"num_read":583,"num_read_kb":897,"num_write":705,"num_write_kb":1089454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"153'781","reported_seq":1738,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728965+0000","last_change":"2023-12-06T15:30:17.617011+0000","last_active":"2023-12-06T16:28:53.728965+0000","last_peered":"2023-12-06T16:28:53.728965+0000","last_clean":"2023-12-06T16:28:53.728965+0000","last_became_active":"2023-12-06T15:25:48.206906+0000","last_became_peered":"2023-12-06T15:25:48.206906+0000","last_unstale":"2023-12-06T16:28:53.728965+0000","last_undegraded":"2023-12-06T16:28:53.728965+0000","last_fullsized":"2023-12-06T16:28:53.728965+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":781,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":40385513,"num_objects":26,"num_object_clones":1,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":771,"num_read_kb":4540,"num_write":652,"num_write_kb":964008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"153'3349","reported_seq":8242,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728490+0000","last_change":"2023-12-06T15:30:17.622402+0000","last_active":"2023-12-06T16:28:53.728490+0000","last_peered":"2023-12-06T16:28:53.728490+0000","last_clean":"2023-12-06T16:28:53.728490+0000","last_became_active":"2023-12-06T15:25:54.220756+0000","last_became_peered":"2023-12-06T15:25:54.220756+0000","last_unstale":"2023-12-06T16:28:53.728490+0000","last_undegraded":"2023-12-06T16:28:53.728490+0000","last_fullsized":"2023-12-06T16:28:53.728490+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":3349,"ondisk_log_size":3349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51299121,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":38,"num_read":12130,"num_read_kb":27934,"num_write":2245,"num_write_kb":1738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":719,"num_flush":173,"num_flush_kb":6205,"num_evict":482,"num_evict_kb":39117,"num_promote":533,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"156'1396","reported_seq":2355,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:32:50.626766+0000","last_change":"2023-12-06T18:32:50.626766+0000","last_active":"2023-12-06T18:32:50.626766+0000","last_peered":"2023-12-06T18:32:50.626766+0000","last_clean":"2023-12-06T18:32:50.626766+0000","last_became_active":"2023-12-06T15:25:48.204290+0000","last_became_peered":"2023-12-06T15:25:48.204290+0000","last_unstale":"2023-12-06T18:32:50.626766+0000","last_undegraded":"2023-12-06T18:32:50.626766+0000","last_fullsized":"2023-12-06T18:32:50.626766+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'1396","last_scrub_stamp":"2023-12-06T18:32:50.626638+0000","last_deep_scrub":"156'1396","last_deep_scrub_stamp":"2023-12-06T18:32:50.626638+0000","last_clean_scrub_stamp":"2023-12-06T18:32:50.626638+0000","log_size":1396,"ondisk_log_size":1396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":73011320,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":688,"num_read_kb":4922,"num_write":819,"num_write_kb":1094364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"153'3641","reported_seq":9475,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728910+0000","last_change":"2023-12-06T15:30:17.620567+0000","last_active":"2023-12-06T16:28:53.728910+0000","last_peered":"2023-12-06T16:28:53.728910+0000","last_clean":"2023-12-06T16:28:53.728910+0000","last_became_active":"2023-12-06T15:25:54.223136+0000","last_became_peered":"2023-12-06T15:25:54.223136+0000","last_unstale":"2023-12-06T16:28:53.728910+0000","last_undegraded":"2023-12-06T16:28:53.728910+0000","last_fullsized":"2023-12-06T16:28:53.728910+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":3641,"ondisk_log_size":3641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11076424,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":42,"num_read":10502,"num_read_kb":28911,"num_write":1839,"num_write_kb":767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":805,"num_flush":189,"num_flush_kb":1977,"num_evict":486,"num_evict_kb":35620,"num_promote":533,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":150,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728781+0000","last_change":"2023-12-06T15:25:48.207167+0000","last_active":"2023-12-06T16:28:53.728781+0000","last_peered":"2023-12-06T16:28:53.728781+0000","last_clean":"2023-12-06T16:28:53.728781+0000","last_became_active":"2023-12-06T15:25:48.206870+0000","last_became_peered":"2023-12-06T15:25:48.206870+0000","last_unstale":"2023-12-06T16:28:53.728781+0000","last_undegraded":"2023-12-06T16:28:53.728781+0000","last_fullsized":"2023-12-06T16:28:53.728781+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"153'1386","reported_seq":2258,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729136+0000","last_change":"2023-12-06T15:30:17.616899+0000","last_active":"2023-12-06T16:28:53.729136+0000","last_peered":"2023-12-06T16:28:53.729136+0000","last_clean":"2023-12-06T16:28:53.729136+0000","last_became_active":"2023-12-06T15:25:48.205750+0000","last_became_peered":"2023-12-06T15:25:48.205750+0000","last_unstale":"2023-12-06T16:28:53.729136+0000","last_undegraded":"2023-12-06T16:28:53.729136+0000","last_fullsized":"2023-12-06T16:28:53.729136+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":1386,"ondisk_log_size":1386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":91811925,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":601,"num_read_kb":4028,"num_write":820,"num_write_kb":1199092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"153'6456","reported_seq":14785,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728858+0000","last_change":"2023-12-06T15:30:17.621570+0000","last_active":"2023-12-06T16:28:53.728858+0000","last_peered":"2023-12-06T16:28:53.728858+0000","last_clean":"2023-12-06T16:28:53.728858+0000","last_became_active":"2023-12-06T15:25:54.221489+0000","last_became_peered":"2023-12-06T15:25:54.221489+0000","last_unstale":"2023-12-06T16:28:53.728858+0000","last_undegraded":"2023-12-06T16:28:53.728858+0000","last_fullsized":"2023-12-06T16:28:53.728858+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":6456,"ondisk_log_size":6456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":42890638,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":35,"num_read":24199,"num_read_kb":36879,"num_write":5231,"num_write_kb":3994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1414,"num_flush":231,"num_flush_kb":8685,"num_evict":509,"num_evict_kb":32296,"num_promote":556,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"156'926","reported_seq":1809,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:32:57.697314+0000","last_change":"2023-12-06T18:32:57.697314+0000","last_active":"2023-12-06T18:32:57.697314+0000","last_peered":"2023-12-06T18:32:57.697314+0000","last_clean":"2023-12-06T18:32:57.697314+0000","last_became_active":"2023-12-06T15:25:48.205967+0000","last_became_peered":"2023-12-06T15:25:48.205967+0000","last_unstale":"2023-12-06T18:32:57.697314+0000","last_undegraded":"2023-12-06T18:32:57.697314+0000","last_fullsized":"2023-12-06T18:32:57.697314+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'926","last_scrub_stamp":"2023-12-06T18:32:57.697195+0000","last_deep_scrub":"156'926","last_deep_scrub_stamp":"2023-12-06T18:32:57.697195+0000","last_clean_scrub_stamp":"2023-12-06T18:32:57.697195+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":113639590,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":664,"num_read_kb":403,"num_write":770,"num_write_kb":1081998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"153'4090","reported_seq":11085,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728527+0000","last_change":"2023-12-06T15:30:17.622674+0000","last_active":"2023-12-06T16:28:53.728527+0000","last_peered":"2023-12-06T16:28:53.728527+0000","last_clean":"2023-12-06T16:28:53.728527+0000","last_became_active":"2023-12-06T15:25:54.221304+0000","last_became_peered":"2023-12-06T15:25:54.221304+0000","last_unstale":"2023-12-06T16:28:53.728527+0000","last_undegraded":"2023-12-06T16:28:53.728527+0000","last_fullsized":"2023-12-06T16:28:53.728527+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":4090,"ondisk_log_size":4090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":41243290,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":40,"num_read":13526,"num_read_kb":30612,"num_write":2847,"num_write_kb":2055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":666,"num_flush":206,"num_flush_kb":5227,"num_evict":428,"num_evict_kb":30690,"num_promote":479,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"153'1069","reported_seq":1936,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728491+0000","last_change":"2023-12-06T15:30:17.621662+0000","last_active":"2023-12-06T16:28:53.728491+0000","last_peered":"2023-12-06T16:28:53.728491+0000","last_clean":"2023-12-06T16:28:53.728491+0000","last_became_active":"2023-12-06T15:25:48.204147+0000","last_became_peered":"2023-12-06T15:25:48.204147+0000","last_unstale":"2023-12-06T16:28:53.728491+0000","last_undegraded":"2023-12-06T16:28:53.728491+0000","last_fullsized":"2023-12-06T16:28:53.728491+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":1069,"ondisk_log_size":1069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127537306,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":556,"num_read_kb":811,"num_write":921,"num_write_kb":1173359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"153'871","reported_seq":1776,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728908+0000","last_change":"2023-12-06T15:30:17.620795+0000","last_active":"2023-12-06T16:28:53.728908+0000","last_peered":"2023-12-06T16:28:53.728908+0000","last_clean":"2023-12-06T16:28:53.728908+0000","last_became_active":"2023-12-06T15:25:48.204913+0000","last_became_peered":"2023-12-06T15:25:48.204913+0000","last_unstale":"2023-12-06T16:28:53.728908+0000","last_undegraded":"2023-12-06T16:28:53.728908+0000","last_fullsized":"2023-12-06T16:28:53.728908+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":871,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":43483484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":604,"num_read_kb":608,"num_write":703,"num_write_kb":1043763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":146509473,"num_objects":216,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":155,"num_read":60357,"num_read_kb":124336,"num_write":12162,"num_write_kb":8554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":16,"num_bytes_hit_set_archive":3604,"num_flush":799,"num_flush_kb":22094,"num_evict":1905,"num_evict_kb":137723,"num_promote":2101,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":187801600,"data_stored":187645250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17536,"ondisk_log_size":17536,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":644057897,"num_objects":264,"num_object_clones":2,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264,"num_whiteouts":2,"num_read":5281,"num_read_kb":19002,"num_write":6262,"num_write_kb":8828450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":271777792,"data_stored":271513170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8274,"ondisk_log_size":8274,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740626,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":444440,"kb_used_data":134928,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93927400,"statfs":{"total":96636764160,"available":96181657600,"internally_reserved":0,"allocated":138166272,"data_stored":137425212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 18:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.224,"5min":0.23400000000000001,"15min":0.22900000000000001},"min":{"1min":0.16600000000000001,"5min":0.13800000000000001,"15min":0.13800000000000001},"max":{"1min":0.35599999999999998,"5min":0.42499999999999999,"15min":0.441},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.23000000000000001,"5min":0.23799999999999999,"15min":0.23499999999999999},"min":{"1min":0.155,"5min":0.155,"15min":0.155},"max":{"1min":0.39000000000000001,"5min":0.442,"15min":0.46100000000000002},"last":0.27300000000000002}]},{"osd":1,"last update":"Wed Dec 6 18:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.23999999999999999,"5min":0.248,"15min":0.247},"min":{"1min":0.16300000000000001,"5min":0.16,"15min":0.16},"max":{"1min":0.379,"5min":0.45400000000000001,"15min":0.48799999999999999},"last":0.314},{"interface":"front","average":{"1min":0.26600000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"min":{"1min":0.21099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.40400000000000003,"5min":0.47299999999999998,"15min":0.48899999999999999},"last":0.251}]}]},{"osd":0,"up_from":8,"seq":34359740625,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":468184,"kb_used_data":158672,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93903656,"statfs":{"total":96636764160,"available":96157343744,"internally_reserved":0,"allocated":162480128,"data_stored":161733705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 18:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.21299999999999999},"min":{"1min":0.13600000000000001,"5min":0.13600000000000001,"15min":0.13200000000000001},"max":{"1min":0.34599999999999997,"5min":0.40600000000000003,"15min":0.45000000000000001},"last":0.16800000000000001},{"interface":"front","average":{"1min":0.25700000000000001,"5min":0.255,"15min":0.255},"min":{"1min":0.19600000000000001,"5min":0.16600000000000001,"15min":0.155},"max":{"1min":0.40799999999999997,"5min":0.44700000000000001,"15min":0.46899999999999997},"last":0.247}]},{"osd":2,"last update":"Wed Dec 6 18:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.221,"5min":0.222,"15min":0.224},"min":{"1min":0.17399999999999999,"5min":0.16400000000000001,"15min":0.152},"max":{"1min":0.374,"5min":0.40999999999999998,"15min":0.441},"last":0.20100000000000001},{"interface":"front","average":{"1min":0.247,"5min":0.23499999999999999,"15min":0.23699999999999999},"min":{"1min":0.184,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.48399999999999999},"last":0.21099999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740626,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":468580,"kb_used_data":159068,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93903260,"statfs":{"total":96636764160,"available":96156938240,"internally_reserved":0,"allocated":162885632,"data_stored":162075943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 18:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.19900000000000001,"5min":0.20499999999999999,"15min":0.21099999999999999},"min":{"1min":0.13500000000000001,"5min":0.13400000000000001,"15min":0.13400000000000001},"max":{"1min":0.36099999999999999,"5min":0.40999999999999998,"15min":0.48599999999999999},"last":0.19400000000000001},{"interface":"front","average":{"1min":0.25900000000000001,"5min":0.26300000000000001,"15min":0.26900000000000002},"min":{"1min":0.17999999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.435,"5min":0.46800000000000003,"15min":0.504},"last":0.25600000000000001}]},{"osd":2,"last update":"Wed Dec 6 18:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23699999999999999},"min":{"1min":0.189,"5min":0.182,"15min":0.16700000000000001},"max":{"1min":0.40500000000000003,"5min":0.443,"15min":0.443},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.246,"5min":0.249,"15min":0.247},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17000000000000001},"max":{"1min":0.39700000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.23300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":92942336,"data_stored":92846518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":135888896,"data_stored":135756585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":42946560,"data_stored":42910067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68222976,"data_stored":68195787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25677824,"data_stored":25626838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":93900800,"data_stored":93822625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T18:33:28.839 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:28.839 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:28.839 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:28.839 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:28.840 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:28.840 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:28.840 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:28.840 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:28.840 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:28.841 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:28.841 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:28.841 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T18:33:29.572 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:29.569+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:29.795 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:29.792+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:30.591 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:30.588+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:30.831 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:30.828+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:31.595 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:31.592+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:31.803 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:31.800+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:32.557 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:32.553+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:32.838 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:32.835+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:33.539 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:33.536+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:33.856 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:33.853+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:34.505 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:34.502+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:34.890 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:34.887+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:35.542 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:35.539+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:35.855 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:35.852+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:36.575 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:36.571+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:36.905 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:36.902+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:37.581 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:37.578+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:37.941 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:37.938+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:38.611 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:38.608+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:38.981 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:38.978+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:39.602 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:39.599+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:39.965 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:39.962+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:40.615 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:40.612+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:41.001 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:40.998+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:41.616 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:41.612+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:41.991 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:41.988+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:42.661 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:42.658+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:42.997 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:42.994+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:43.705 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:43.702+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:43.960 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:43.957+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:44.704 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:44.700+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:44.972 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:44.969+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:45.723 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:45.720+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:45.982 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:45.978+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:46.749 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:46.746+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:46.941 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:46.938+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:47.732 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:47.729+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:47.947 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:47.944+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:48.768 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:48.764+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:48.842 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T18:33:48.909 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:48.906+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:49.146 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T18:33:49.148 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2023-12-06T18:33:49.159 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":5794,"stamp":"2023-12-06T18:33:48.806409+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":790567370,"num_objects":480,"num_object_clones":2,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":385,"num_whiteouts":157,"num_read":65638,"num_read_kb":143338,"num_write":18424,"num_write_kb":8837004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":16,"num_bytes_hit_set_archive":3604,"num_flush":799,"num_flush_kb":22094,"num_evict":1905,"num_evict_kb":137723,"num_promote":2101,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25810,"ondisk_log_size":25810,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1381204,"kb_used_data":452668,"kb_used_omap":0,"kb_used_meta":928512,"kb_avail":281734316,"statfs":{"total":289910292480,"available":288495939584,"internally_reserved":0,"allocated":463532032,"data_stored":461234860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":950796288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001971"},"pg_stats":[{"pgid":"2.7","version":"153'998","reported_seq":1985,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729083+0000","last_change":"2023-12-06T15:30:17.617146+0000","last_active":"2023-12-06T16:28:53.729083+0000","last_peered":"2023-12-06T16:28:53.729083+0000","last_clean":"2023-12-06T16:28:53.729083+0000","last_became_active":"2023-12-06T15:25:48.206888+0000","last_became_peered":"2023-12-06T15:25:48.206888+0000","last_unstale":"2023-12-06T16:28:53.729083+0000","last_undegraded":"2023-12-06T16:28:53.729083+0000","last_fullsized":"2023-12-06T16:28:53.729083+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":998,"ondisk_log_size":998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":106983625,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":814,"num_read_kb":2793,"num_write":872,"num_write_kb":1182412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"153'847","reported_seq":1720,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729016+0000","last_change":"2023-12-06T15:30:17.617250+0000","last_active":"2023-12-06T16:28:53.729016+0000","last_peered":"2023-12-06T16:28:53.729016+0000","last_clean":"2023-12-06T16:28:53.729016+0000","last_became_active":"2023-12-06T15:25:48.206986+0000","last_became_peered":"2023-12-06T15:25:48.206986+0000","last_unstale":"2023-12-06T16:28:53.729016+0000","last_undegraded":"2023-12-06T16:28:53.729016+0000","last_fullsized":"2023-12-06T16:28:53.729016+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":847,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":47205134,"num_objects":21,"num_object_clones":1,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":1,"num_read":583,"num_read_kb":897,"num_write":705,"num_write_kb":1089454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"153'781","reported_seq":1738,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728965+0000","last_change":"2023-12-06T15:30:17.617011+0000","last_active":"2023-12-06T16:28:53.728965+0000","last_peered":"2023-12-06T16:28:53.728965+0000","last_clean":"2023-12-06T16:28:53.728965+0000","last_became_active":"2023-12-06T15:25:48.206906+0000","last_became_peered":"2023-12-06T15:25:48.206906+0000","last_unstale":"2023-12-06T16:28:53.728965+0000","last_undegraded":"2023-12-06T16:28:53.728965+0000","last_fullsized":"2023-12-06T16:28:53.728965+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":781,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":40385513,"num_objects":26,"num_object_clones":1,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":771,"num_read_kb":4540,"num_write":652,"num_write_kb":964008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"153'3349","reported_seq":8242,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728490+0000","last_change":"2023-12-06T15:30:17.622402+0000","last_active":"2023-12-06T16:28:53.728490+0000","last_peered":"2023-12-06T16:28:53.728490+0000","last_clean":"2023-12-06T16:28:53.728490+0000","last_became_active":"2023-12-06T15:25:54.220756+0000","last_became_peered":"2023-12-06T15:25:54.220756+0000","last_unstale":"2023-12-06T16:28:53.728490+0000","last_undegraded":"2023-12-06T16:28:53.728490+0000","last_fullsized":"2023-12-06T16:28:53.728490+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":3349,"ondisk_log_size":3349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51299121,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":38,"num_read":12130,"num_read_kb":27934,"num_write":2245,"num_write_kb":1738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":719,"num_flush":173,"num_flush_kb":6205,"num_evict":482,"num_evict_kb":39117,"num_promote":533,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"156'1396","reported_seq":2355,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:32:50.626766+0000","last_change":"2023-12-06T18:32:50.626766+0000","last_active":"2023-12-06T18:32:50.626766+0000","last_peered":"2023-12-06T18:32:50.626766+0000","last_clean":"2023-12-06T18:32:50.626766+0000","last_became_active":"2023-12-06T15:25:48.204290+0000","last_became_peered":"2023-12-06T15:25:48.204290+0000","last_unstale":"2023-12-06T18:32:50.626766+0000","last_undegraded":"2023-12-06T18:32:50.626766+0000","last_fullsized":"2023-12-06T18:32:50.626766+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'1396","last_scrub_stamp":"2023-12-06T18:32:50.626638+0000","last_deep_scrub":"156'1396","last_deep_scrub_stamp":"2023-12-06T18:32:50.626638+0000","last_clean_scrub_stamp":"2023-12-06T18:32:50.626638+0000","log_size":1396,"ondisk_log_size":1396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":73011320,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":688,"num_read_kb":4922,"num_write":819,"num_write_kb":1094364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"153'3641","reported_seq":9475,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728910+0000","last_change":"2023-12-06T15:30:17.620567+0000","last_active":"2023-12-06T16:28:53.728910+0000","last_peered":"2023-12-06T16:28:53.728910+0000","last_clean":"2023-12-06T16:28:53.728910+0000","last_became_active":"2023-12-06T15:25:54.223136+0000","last_became_peered":"2023-12-06T15:25:54.223136+0000","last_unstale":"2023-12-06T16:28:53.728910+0000","last_undegraded":"2023-12-06T16:28:53.728910+0000","last_fullsized":"2023-12-06T16:28:53.728910+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":3641,"ondisk_log_size":3641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11076424,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":42,"num_read":10502,"num_read_kb":28911,"num_write":1839,"num_write_kb":767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":805,"num_flush":189,"num_flush_kb":1977,"num_evict":486,"num_evict_kb":35620,"num_promote":533,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":150,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728781+0000","last_change":"2023-12-06T15:25:48.207167+0000","last_active":"2023-12-06T16:28:53.728781+0000","last_peered":"2023-12-06T16:28:53.728781+0000","last_clean":"2023-12-06T16:28:53.728781+0000","last_became_active":"2023-12-06T15:25:48.206870+0000","last_became_peered":"2023-12-06T15:25:48.206870+0000","last_unstale":"2023-12-06T16:28:53.728781+0000","last_undegraded":"2023-12-06T16:28:53.728781+0000","last_fullsized":"2023-12-06T16:28:53.728781+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"153'1386","reported_seq":2258,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729136+0000","last_change":"2023-12-06T15:30:17.616899+0000","last_active":"2023-12-06T16:28:53.729136+0000","last_peered":"2023-12-06T16:28:53.729136+0000","last_clean":"2023-12-06T16:28:53.729136+0000","last_became_active":"2023-12-06T15:25:48.205750+0000","last_became_peered":"2023-12-06T15:25:48.205750+0000","last_unstale":"2023-12-06T16:28:53.729136+0000","last_undegraded":"2023-12-06T16:28:53.729136+0000","last_fullsized":"2023-12-06T16:28:53.729136+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":1386,"ondisk_log_size":1386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":91811925,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":601,"num_read_kb":4028,"num_write":820,"num_write_kb":1199092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"153'6456","reported_seq":14785,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728858+0000","last_change":"2023-12-06T15:30:17.621570+0000","last_active":"2023-12-06T16:28:53.728858+0000","last_peered":"2023-12-06T16:28:53.728858+0000","last_clean":"2023-12-06T16:28:53.728858+0000","last_became_active":"2023-12-06T15:25:54.221489+0000","last_became_peered":"2023-12-06T15:25:54.221489+0000","last_unstale":"2023-12-06T16:28:53.728858+0000","last_undegraded":"2023-12-06T16:28:53.728858+0000","last_fullsized":"2023-12-06T16:28:53.728858+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":6456,"ondisk_log_size":6456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":42890638,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":35,"num_read":24199,"num_read_kb":36879,"num_write":5231,"num_write_kb":3994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1414,"num_flush":231,"num_flush_kb":8685,"num_evict":509,"num_evict_kb":32296,"num_promote":556,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"156'926","reported_seq":1809,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:32:57.697314+0000","last_change":"2023-12-06T18:32:57.697314+0000","last_active":"2023-12-06T18:32:57.697314+0000","last_peered":"2023-12-06T18:32:57.697314+0000","last_clean":"2023-12-06T18:32:57.697314+0000","last_became_active":"2023-12-06T15:25:48.205967+0000","last_became_peered":"2023-12-06T15:25:48.205967+0000","last_unstale":"2023-12-06T18:32:57.697314+0000","last_undegraded":"2023-12-06T18:32:57.697314+0000","last_fullsized":"2023-12-06T18:32:57.697314+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'926","last_scrub_stamp":"2023-12-06T18:32:57.697195+0000","last_deep_scrub":"156'926","last_deep_scrub_stamp":"2023-12-06T18:32:57.697195+0000","last_clean_scrub_stamp":"2023-12-06T18:32:57.697195+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":113639590,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":664,"num_read_kb":403,"num_write":770,"num_write_kb":1081998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"153'4090","reported_seq":11085,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728527+0000","last_change":"2023-12-06T15:30:17.622674+0000","last_active":"2023-12-06T16:28:53.728527+0000","last_peered":"2023-12-06T16:28:53.728527+0000","last_clean":"2023-12-06T16:28:53.728527+0000","last_became_active":"2023-12-06T15:25:54.221304+0000","last_became_peered":"2023-12-06T15:25:54.221304+0000","last_unstale":"2023-12-06T16:28:53.728527+0000","last_undegraded":"2023-12-06T16:28:53.728527+0000","last_fullsized":"2023-12-06T16:28:53.728527+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":4090,"ondisk_log_size":4090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":41243290,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":40,"num_read":13526,"num_read_kb":30612,"num_write":2847,"num_write_kb":2055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":666,"num_flush":206,"num_flush_kb":5227,"num_evict":428,"num_evict_kb":30690,"num_promote":479,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"153'1069","reported_seq":1936,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728491+0000","last_change":"2023-12-06T15:30:17.621662+0000","last_active":"2023-12-06T16:28:53.728491+0000","last_peered":"2023-12-06T16:28:53.728491+0000","last_clean":"2023-12-06T16:28:53.728491+0000","last_became_active":"2023-12-06T15:25:48.204147+0000","last_became_peered":"2023-12-06T15:25:48.204147+0000","last_unstale":"2023-12-06T16:28:53.728491+0000","last_undegraded":"2023-12-06T16:28:53.728491+0000","last_fullsized":"2023-12-06T16:28:53.728491+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":1069,"ondisk_log_size":1069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127537306,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":556,"num_read_kb":811,"num_write":921,"num_write_kb":1173359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"153'871","reported_seq":1776,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728908+0000","last_change":"2023-12-06T15:30:17.620795+0000","last_active":"2023-12-06T16:28:53.728908+0000","last_peered":"2023-12-06T16:28:53.728908+0000","last_clean":"2023-12-06T16:28:53.728908+0000","last_became_active":"2023-12-06T15:25:48.204913+0000","last_became_peered":"2023-12-06T15:25:48.204913+0000","last_unstale":"2023-12-06T16:28:53.728908+0000","last_undegraded":"2023-12-06T16:28:53.728908+0000","last_fullsized":"2023-12-06T16:28:53.728908+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":871,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":43483484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":604,"num_read_kb":608,"num_write":703,"num_write_kb":1043763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":146509473,"num_objects":216,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":155,"num_read":60357,"num_read_kb":124336,"num_write":12162,"num_write_kb":8554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":16,"num_bytes_hit_set_archive":3604,"num_flush":799,"num_flush_kb":22094,"num_evict":1905,"num_evict_kb":137723,"num_promote":2101,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":187801600,"data_stored":187645250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17536,"ondisk_log_size":17536,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":644057897,"num_objects":264,"num_object_clones":2,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264,"num_whiteouts":2,"num_read":5281,"num_read_kb":19002,"num_write":6262,"num_write_kb":8828450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":271777792,"data_stored":271513170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8274,"ondisk_log_size":8274,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740630,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":444440,"kb_used_data":134928,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93927400,"statfs":{"total":96636764160,"available":96181657600,"internally_reserved":0,"allocated":138166272,"data_stored":137425212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 18:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.224,"5min":0.23400000000000001,"15min":0.22900000000000001},"min":{"1min":0.16600000000000001,"5min":0.13800000000000001,"15min":0.13800000000000001},"max":{"1min":0.35599999999999998,"5min":0.42499999999999999,"15min":0.441},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.23000000000000001,"5min":0.23799999999999999,"15min":0.23499999999999999},"min":{"1min":0.155,"5min":0.155,"15min":0.155},"max":{"1min":0.39000000000000001,"5min":0.442,"15min":0.46100000000000002},"last":0.26700000000000002}]},{"osd":1,"last update":"Wed Dec 6 18:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.23999999999999999,"5min":0.248,"15min":0.247},"min":{"1min":0.16300000000000001,"5min":0.16,"15min":0.16},"max":{"1min":0.379,"5min":0.45400000000000001,"15min":0.48799999999999999},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.26600000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"min":{"1min":0.21099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.40400000000000003,"5min":0.47299999999999998,"15min":0.48899999999999999},"last":0.28100000000000003}]}]},{"osd":0,"up_from":8,"seq":34359740629,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":468184,"kb_used_data":158672,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93903656,"statfs":{"total":96636764160,"available":96157343744,"internally_reserved":0,"allocated":162480128,"data_stored":161733705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 18:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.21299999999999999},"min":{"1min":0.13600000000000001,"5min":0.13600000000000001,"15min":0.13200000000000001},"max":{"1min":0.34599999999999997,"5min":0.40600000000000003,"15min":0.45000000000000001},"last":0.154},{"interface":"front","average":{"1min":0.25700000000000001,"5min":0.255,"15min":0.255},"min":{"1min":0.19600000000000001,"5min":0.16600000000000001,"15min":0.155},"max":{"1min":0.40799999999999997,"5min":0.44700000000000001,"15min":0.46899999999999997},"last":0.216}]},{"osd":2,"last update":"Wed Dec 6 18:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.221,"5min":0.222,"15min":0.224},"min":{"1min":0.17399999999999999,"5min":0.16400000000000001,"15min":0.152},"max":{"1min":0.374,"5min":0.40999999999999998,"15min":0.441},"last":0.19600000000000001},{"interface":"front","average":{"1min":0.247,"5min":0.23499999999999999,"15min":0.23699999999999999},"min":{"1min":0.184,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.48399999999999999},"last":0.20699999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740630,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":468580,"kb_used_data":159068,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93903260,"statfs":{"total":96636764160,"available":96156938240,"internally_reserved":0,"allocated":162885632,"data_stored":162075943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 18:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.19900000000000001,"5min":0.20499999999999999,"15min":0.21099999999999999},"min":{"1min":0.13500000000000001,"5min":0.13400000000000001,"15min":0.13400000000000001},"max":{"1min":0.36099999999999999,"5min":0.40999999999999998,"15min":0.48599999999999999},"last":0.189},{"interface":"front","average":{"1min":0.25900000000000001,"5min":0.26300000000000001,"15min":0.26900000000000002},"min":{"1min":0.17999999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.435,"5min":0.46800000000000003,"15min":0.504},"last":0.26600000000000001}]},{"osd":2,"last update":"Wed Dec 6 18:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23699999999999999},"min":{"1min":0.189,"5min":0.182,"15min":0.16700000000000001},"max":{"1min":0.40500000000000003,"5min":0.443,"15min":0.443},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.246,"5min":0.249,"15min":0.247},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17000000000000001},"max":{"1min":0.39700000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.218}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":92942336,"data_stored":92846518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":135888896,"data_stored":135756585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":42946560,"data_stored":42910067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68222976,"data_stored":68195787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25677824,"data_stored":25626838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":93900800,"data_stored":93822625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T18:33:49.160 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:49.160 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:49.160 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:49.161 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:49.161 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:49.161 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:49.161 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:49.161 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:49.161 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:49.162 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:49.162 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:33:49.162 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T18:33:49.743 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:49.740+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:49.930 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:49.927+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:50.743 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:50.739+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:50.922 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:50.919+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:51.749 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:51.746+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:51.907 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:51.904+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:52.761 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:52.758+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:52.920 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:52.917+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:53.719 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:53.716+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:53.896 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:53.892+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:54.687 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:54.684+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:54.863 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:54.860+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:55.665 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:55.662+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:55.825 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:55.822+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:56.680 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:56.676+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:56.793 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:56.789+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:57.731 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:57.727+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:57.815 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:57.811+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:58.719 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:58.714+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:58.835 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:58.831+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:33:59.733 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:33:59.729+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:33:59.789 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:33:59.785+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:00.747 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:00.743+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:00.785 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:00.781+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:01.729 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:01.725+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:01.815 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:01.811+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:02.766 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:02.762+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:02.822 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:02.818+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:03.727 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:03.723+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:03.827 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:03.823+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:04.686 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:04.682+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:04.794 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:04.790+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:05.643 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:05.640+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:05.786 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:05.782+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:06.596 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:06.593+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:06.764 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:06.761+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:07.638 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:07.635+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:07.730 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:07.727+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:08.672 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:08.669+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:08.762 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:08.759+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:09.163 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T18:34:09.463 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T18:34:09.464 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2023-12-06T18:34:09.475 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":5804,"stamp":"2023-12-06T18:34:08.809532+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":790567370,"num_objects":480,"num_object_clones":2,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":385,"num_whiteouts":157,"num_read":65638,"num_read_kb":143338,"num_write":18424,"num_write_kb":8837004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":16,"num_bytes_hit_set_archive":3604,"num_flush":799,"num_flush_kb":22094,"num_evict":1905,"num_evict_kb":137723,"num_promote":2101,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25810,"ondisk_log_size":25810,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1381204,"kb_used_data":452668,"kb_used_omap":0,"kb_used_meta":928512,"kb_avail":281734316,"statfs":{"total":289910292480,"available":288495939584,"internally_reserved":0,"allocated":463532032,"data_stored":461234860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":950796288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001831"},"pg_stats":[{"pgid":"2.7","version":"153'998","reported_seq":1985,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729083+0000","last_change":"2023-12-06T15:30:17.617146+0000","last_active":"2023-12-06T16:28:53.729083+0000","last_peered":"2023-12-06T16:28:53.729083+0000","last_clean":"2023-12-06T16:28:53.729083+0000","last_became_active":"2023-12-06T15:25:48.206888+0000","last_became_peered":"2023-12-06T15:25:48.206888+0000","last_unstale":"2023-12-06T16:28:53.729083+0000","last_undegraded":"2023-12-06T16:28:53.729083+0000","last_fullsized":"2023-12-06T16:28:53.729083+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":998,"ondisk_log_size":998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":106983625,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":814,"num_read_kb":2793,"num_write":872,"num_write_kb":1182412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"153'847","reported_seq":1720,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729016+0000","last_change":"2023-12-06T15:30:17.617250+0000","last_active":"2023-12-06T16:28:53.729016+0000","last_peered":"2023-12-06T16:28:53.729016+0000","last_clean":"2023-12-06T16:28:53.729016+0000","last_became_active":"2023-12-06T15:25:48.206986+0000","last_became_peered":"2023-12-06T15:25:48.206986+0000","last_unstale":"2023-12-06T16:28:53.729016+0000","last_undegraded":"2023-12-06T16:28:53.729016+0000","last_fullsized":"2023-12-06T16:28:53.729016+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":847,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":47205134,"num_objects":21,"num_object_clones":1,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":1,"num_read":583,"num_read_kb":897,"num_write":705,"num_write_kb":1089454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"153'781","reported_seq":1738,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728965+0000","last_change":"2023-12-06T15:30:17.617011+0000","last_active":"2023-12-06T16:28:53.728965+0000","last_peered":"2023-12-06T16:28:53.728965+0000","last_clean":"2023-12-06T16:28:53.728965+0000","last_became_active":"2023-12-06T15:25:48.206906+0000","last_became_peered":"2023-12-06T15:25:48.206906+0000","last_unstale":"2023-12-06T16:28:53.728965+0000","last_undegraded":"2023-12-06T16:28:53.728965+0000","last_fullsized":"2023-12-06T16:28:53.728965+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":781,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":40385513,"num_objects":26,"num_object_clones":1,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":771,"num_read_kb":4540,"num_write":652,"num_write_kb":964008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"153'3349","reported_seq":8242,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728490+0000","last_change":"2023-12-06T15:30:17.622402+0000","last_active":"2023-12-06T16:28:53.728490+0000","last_peered":"2023-12-06T16:28:53.728490+0000","last_clean":"2023-12-06T16:28:53.728490+0000","last_became_active":"2023-12-06T15:25:54.220756+0000","last_became_peered":"2023-12-06T15:25:54.220756+0000","last_unstale":"2023-12-06T16:28:53.728490+0000","last_undegraded":"2023-12-06T16:28:53.728490+0000","last_fullsized":"2023-12-06T16:28:53.728490+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":3349,"ondisk_log_size":3349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51299121,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":38,"num_read":12130,"num_read_kb":27934,"num_write":2245,"num_write_kb":1738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":719,"num_flush":173,"num_flush_kb":6205,"num_evict":482,"num_evict_kb":39117,"num_promote":533,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"156'1396","reported_seq":2355,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:32:50.626766+0000","last_change":"2023-12-06T18:32:50.626766+0000","last_active":"2023-12-06T18:32:50.626766+0000","last_peered":"2023-12-06T18:32:50.626766+0000","last_clean":"2023-12-06T18:32:50.626766+0000","last_became_active":"2023-12-06T15:25:48.204290+0000","last_became_peered":"2023-12-06T15:25:48.204290+0000","last_unstale":"2023-12-06T18:32:50.626766+0000","last_undegraded":"2023-12-06T18:32:50.626766+0000","last_fullsized":"2023-12-06T18:32:50.626766+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'1396","last_scrub_stamp":"2023-12-06T18:32:50.626638+0000","last_deep_scrub":"156'1396","last_deep_scrub_stamp":"2023-12-06T18:32:50.626638+0000","last_clean_scrub_stamp":"2023-12-06T18:32:50.626638+0000","log_size":1396,"ondisk_log_size":1396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":73011320,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":688,"num_read_kb":4922,"num_write":819,"num_write_kb":1094364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"153'3641","reported_seq":9475,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728910+0000","last_change":"2023-12-06T15:30:17.620567+0000","last_active":"2023-12-06T16:28:53.728910+0000","last_peered":"2023-12-06T16:28:53.728910+0000","last_clean":"2023-12-06T16:28:53.728910+0000","last_became_active":"2023-12-06T15:25:54.223136+0000","last_became_peered":"2023-12-06T15:25:54.223136+0000","last_unstale":"2023-12-06T16:28:53.728910+0000","last_undegraded":"2023-12-06T16:28:53.728910+0000","last_fullsized":"2023-12-06T16:28:53.728910+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":3641,"ondisk_log_size":3641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11076424,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":42,"num_read":10502,"num_read_kb":28911,"num_write":1839,"num_write_kb":767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":805,"num_flush":189,"num_flush_kb":1977,"num_evict":486,"num_evict_kb":35620,"num_promote":533,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":150,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728781+0000","last_change":"2023-12-06T15:25:48.207167+0000","last_active":"2023-12-06T16:28:53.728781+0000","last_peered":"2023-12-06T16:28:53.728781+0000","last_clean":"2023-12-06T16:28:53.728781+0000","last_became_active":"2023-12-06T15:25:48.206870+0000","last_became_peered":"2023-12-06T15:25:48.206870+0000","last_unstale":"2023-12-06T16:28:53.728781+0000","last_undegraded":"2023-12-06T16:28:53.728781+0000","last_fullsized":"2023-12-06T16:28:53.728781+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"153'1386","reported_seq":2258,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729136+0000","last_change":"2023-12-06T15:30:17.616899+0000","last_active":"2023-12-06T16:28:53.729136+0000","last_peered":"2023-12-06T16:28:53.729136+0000","last_clean":"2023-12-06T16:28:53.729136+0000","last_became_active":"2023-12-06T15:25:48.205750+0000","last_became_peered":"2023-12-06T15:25:48.205750+0000","last_unstale":"2023-12-06T16:28:53.729136+0000","last_undegraded":"2023-12-06T16:28:53.729136+0000","last_fullsized":"2023-12-06T16:28:53.729136+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":1386,"ondisk_log_size":1386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":91811925,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":601,"num_read_kb":4028,"num_write":820,"num_write_kb":1199092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"153'6456","reported_seq":14785,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728858+0000","last_change":"2023-12-06T15:30:17.621570+0000","last_active":"2023-12-06T16:28:53.728858+0000","last_peered":"2023-12-06T16:28:53.728858+0000","last_clean":"2023-12-06T16:28:53.728858+0000","last_became_active":"2023-12-06T15:25:54.221489+0000","last_became_peered":"2023-12-06T15:25:54.221489+0000","last_unstale":"2023-12-06T16:28:53.728858+0000","last_undegraded":"2023-12-06T16:28:53.728858+0000","last_fullsized":"2023-12-06T16:28:53.728858+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":6456,"ondisk_log_size":6456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":42890638,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":35,"num_read":24199,"num_read_kb":36879,"num_write":5231,"num_write_kb":3994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1414,"num_flush":231,"num_flush_kb":8685,"num_evict":509,"num_evict_kb":32296,"num_promote":556,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"156'926","reported_seq":1809,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:32:57.697314+0000","last_change":"2023-12-06T18:32:57.697314+0000","last_active":"2023-12-06T18:32:57.697314+0000","last_peered":"2023-12-06T18:32:57.697314+0000","last_clean":"2023-12-06T18:32:57.697314+0000","last_became_active":"2023-12-06T15:25:48.205967+0000","last_became_peered":"2023-12-06T15:25:48.205967+0000","last_unstale":"2023-12-06T18:32:57.697314+0000","last_undegraded":"2023-12-06T18:32:57.697314+0000","last_fullsized":"2023-12-06T18:32:57.697314+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'926","last_scrub_stamp":"2023-12-06T18:32:57.697195+0000","last_deep_scrub":"156'926","last_deep_scrub_stamp":"2023-12-06T18:32:57.697195+0000","last_clean_scrub_stamp":"2023-12-06T18:32:57.697195+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":113639590,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":664,"num_read_kb":403,"num_write":770,"num_write_kb":1081998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"153'4090","reported_seq":11085,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728527+0000","last_change":"2023-12-06T15:30:17.622674+0000","last_active":"2023-12-06T16:28:53.728527+0000","last_peered":"2023-12-06T16:28:53.728527+0000","last_clean":"2023-12-06T16:28:53.728527+0000","last_became_active":"2023-12-06T15:25:54.221304+0000","last_became_peered":"2023-12-06T15:25:54.221304+0000","last_unstale":"2023-12-06T16:28:53.728527+0000","last_undegraded":"2023-12-06T16:28:53.728527+0000","last_fullsized":"2023-12-06T16:28:53.728527+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":4090,"ondisk_log_size":4090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":41243290,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":40,"num_read":13526,"num_read_kb":30612,"num_write":2847,"num_write_kb":2055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":666,"num_flush":206,"num_flush_kb":5227,"num_evict":428,"num_evict_kb":30690,"num_promote":479,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"153'1069","reported_seq":1936,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728491+0000","last_change":"2023-12-06T15:30:17.621662+0000","last_active":"2023-12-06T16:28:53.728491+0000","last_peered":"2023-12-06T16:28:53.728491+0000","last_clean":"2023-12-06T16:28:53.728491+0000","last_became_active":"2023-12-06T15:25:48.204147+0000","last_became_peered":"2023-12-06T15:25:48.204147+0000","last_unstale":"2023-12-06T16:28:53.728491+0000","last_undegraded":"2023-12-06T16:28:53.728491+0000","last_fullsized":"2023-12-06T16:28:53.728491+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":1069,"ondisk_log_size":1069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127537306,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":556,"num_read_kb":811,"num_write":921,"num_write_kb":1173359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"153'871","reported_seq":1776,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728908+0000","last_change":"2023-12-06T15:30:17.620795+0000","last_active":"2023-12-06T16:28:53.728908+0000","last_peered":"2023-12-06T16:28:53.728908+0000","last_clean":"2023-12-06T16:28:53.728908+0000","last_became_active":"2023-12-06T15:25:48.204913+0000","last_became_peered":"2023-12-06T15:25:48.204913+0000","last_unstale":"2023-12-06T16:28:53.728908+0000","last_undegraded":"2023-12-06T16:28:53.728908+0000","last_fullsized":"2023-12-06T16:28:53.728908+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":871,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":43483484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":604,"num_read_kb":608,"num_write":703,"num_write_kb":1043763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":146509473,"num_objects":216,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":155,"num_read":60357,"num_read_kb":124336,"num_write":12162,"num_write_kb":8554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":16,"num_bytes_hit_set_archive":3604,"num_flush":799,"num_flush_kb":22094,"num_evict":1905,"num_evict_kb":137723,"num_promote":2101,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":187801600,"data_stored":187645250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17536,"ondisk_log_size":17536,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":644057897,"num_objects":264,"num_object_clones":2,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264,"num_whiteouts":2,"num_read":5281,"num_read_kb":19002,"num_write":6262,"num_write_kb":8828450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":271777792,"data_stored":271513170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8274,"ondisk_log_size":8274,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740634,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":444440,"kb_used_data":134928,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93927400,"statfs":{"total":96636764160,"available":96181657600,"internally_reserved":0,"allocated":138166272,"data_stored":137425212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 18:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.224,"5min":0.23400000000000001,"15min":0.22900000000000001},"min":{"1min":0.16600000000000001,"5min":0.13800000000000001,"15min":0.13800000000000001},"max":{"1min":0.35599999999999998,"5min":0.42499999999999999,"15min":0.441},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.23000000000000001,"5min":0.23799999999999999,"15min":0.23499999999999999},"min":{"1min":0.155,"5min":0.155,"15min":0.155},"max":{"1min":0.39000000000000001,"5min":0.442,"15min":0.46100000000000002},"last":0.183}]},{"osd":1,"last update":"Wed Dec 6 18:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.23999999999999999,"5min":0.248,"15min":0.247},"min":{"1min":0.16300000000000001,"5min":0.16,"15min":0.16},"max":{"1min":0.379,"5min":0.45400000000000001,"15min":0.48799999999999999},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.26600000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"min":{"1min":0.21099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.40400000000000003,"5min":0.47299999999999998,"15min":0.48899999999999999},"last":0.254}]}]},{"osd":0,"up_from":8,"seq":34359740633,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":468184,"kb_used_data":158672,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93903656,"statfs":{"total":96636764160,"available":96157343744,"internally_reserved":0,"allocated":162480128,"data_stored":161733705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 18:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.21299999999999999},"min":{"1min":0.13600000000000001,"5min":0.13600000000000001,"15min":0.13200000000000001},"max":{"1min":0.34599999999999997,"5min":0.40600000000000003,"15min":0.45000000000000001},"last":0.16200000000000001},{"interface":"front","average":{"1min":0.25700000000000001,"5min":0.255,"15min":0.255},"min":{"1min":0.19600000000000001,"5min":0.16600000000000001,"15min":0.155},"max":{"1min":0.40799999999999997,"5min":0.44700000000000001,"15min":0.46899999999999997},"last":0.221}]},{"osd":2,"last update":"Wed Dec 6 18:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.221,"5min":0.222,"15min":0.224},"min":{"1min":0.17399999999999999,"5min":0.16400000000000001,"15min":0.152},"max":{"1min":0.374,"5min":0.40999999999999998,"15min":0.441},"last":0.20200000000000001},{"interface":"front","average":{"1min":0.247,"5min":0.23499999999999999,"15min":0.23699999999999999},"min":{"1min":0.184,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.48399999999999999},"last":0.19600000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740634,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":468580,"kb_used_data":159068,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93903260,"statfs":{"total":96636764160,"available":96156938240,"internally_reserved":0,"allocated":162885632,"data_stored":162075943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 18:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.19900000000000001,"5min":0.20499999999999999,"15min":0.21099999999999999},"min":{"1min":0.13500000000000001,"5min":0.13400000000000001,"15min":0.13400000000000001},"max":{"1min":0.36099999999999999,"5min":0.40999999999999998,"15min":0.48599999999999999},"last":0.192},{"interface":"front","average":{"1min":0.25900000000000001,"5min":0.26300000000000001,"15min":0.26900000000000002},"min":{"1min":0.17999999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.435,"5min":0.46800000000000003,"15min":0.504},"last":0.26000000000000001}]},{"osd":2,"last update":"Wed Dec 6 18:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23699999999999999},"min":{"1min":0.189,"5min":0.182,"15min":0.16700000000000001},"max":{"1min":0.40500000000000003,"5min":0.443,"15min":0.443},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.246,"5min":0.249,"15min":0.247},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17000000000000001},"max":{"1min":0.39700000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.217}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":92942336,"data_stored":92846518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":135888896,"data_stored":135756585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":42946560,"data_stored":42910067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68222976,"data_stored":68195787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25677824,"data_stored":25626838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":93900800,"data_stored":93822625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T18:34:09.476 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:09.477 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:09.477 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:09.477 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:09.477 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:09.477 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:09.477 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:09.478 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:09.478 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:09.478 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:09.478 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:09.478 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T18:34:09.694 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:09.691+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:09.788 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:09.785+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:10.655 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:10.652+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:10.761 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:10.757+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:11.691 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:11.688+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:11.743 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:11.740+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:12.702 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:12.699+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:12.706 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:12.703+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:13.730 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:13.727+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:13.749 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:13.746+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:14.739 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:14.736+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:14.769 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:14.766+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:15.725 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:15.722+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:15.726 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:15.723+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:16.713 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:16.710+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:16.737 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:16.734+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:17.754 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:17.751+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:17.783 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:17.780+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:18.728 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:18.725+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:18.744 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:18.741+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:19.722 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:19.719+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:19.728 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:19.725+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:20.763 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:20.759+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:20.778 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:20.775+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:21.732 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:21.729+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:21.776 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:21.773+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:22.735 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:22.732+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:22.740 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:22.737+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:23.736 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:23.733+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:23.779 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:23.775+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:24.785 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:24.782+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:24.814 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:24.811+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:25.754 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:25.750+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:25.767 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:25.763+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:26.731 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:26.728+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:26.805 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:26.802+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:27.732 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:27.729+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:27.807 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:27.804+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:28.772 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:28.769+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:28.856 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:28.853+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:29.479 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T18:34:29.728 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:29.725+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:29.817 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T18:34:29.819 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2023-12-06T18:34:29.831 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":5814,"stamp":"2023-12-06T18:34:28.813128+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":790567370,"num_objects":480,"num_object_clones":2,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":385,"num_whiteouts":157,"num_read":65638,"num_read_kb":143338,"num_write":18424,"num_write_kb":8837004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":16,"num_bytes_hit_set_archive":3604,"num_flush":799,"num_flush_kb":22094,"num_evict":1905,"num_evict_kb":137723,"num_promote":2101,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25810,"ondisk_log_size":25810,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1381204,"kb_used_data":452668,"kb_used_omap":0,"kb_used_meta":928512,"kb_avail":281734316,"statfs":{"total":289910292480,"available":288495939584,"internally_reserved":0,"allocated":463532032,"data_stored":461234860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":950796288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001922"},"pg_stats":[{"pgid":"2.7","version":"153'998","reported_seq":1985,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729083+0000","last_change":"2023-12-06T15:30:17.617146+0000","last_active":"2023-12-06T16:28:53.729083+0000","last_peered":"2023-12-06T16:28:53.729083+0000","last_clean":"2023-12-06T16:28:53.729083+0000","last_became_active":"2023-12-06T15:25:48.206888+0000","last_became_peered":"2023-12-06T15:25:48.206888+0000","last_unstale":"2023-12-06T16:28:53.729083+0000","last_undegraded":"2023-12-06T16:28:53.729083+0000","last_fullsized":"2023-12-06T16:28:53.729083+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":998,"ondisk_log_size":998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":106983625,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":814,"num_read_kb":2793,"num_write":872,"num_write_kb":1182412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"153'847","reported_seq":1720,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729016+0000","last_change":"2023-12-06T15:30:17.617250+0000","last_active":"2023-12-06T16:28:53.729016+0000","last_peered":"2023-12-06T16:28:53.729016+0000","last_clean":"2023-12-06T16:28:53.729016+0000","last_became_active":"2023-12-06T15:25:48.206986+0000","last_became_peered":"2023-12-06T15:25:48.206986+0000","last_unstale":"2023-12-06T16:28:53.729016+0000","last_undegraded":"2023-12-06T16:28:53.729016+0000","last_fullsized":"2023-12-06T16:28:53.729016+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":847,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":47205134,"num_objects":21,"num_object_clones":1,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":1,"num_read":583,"num_read_kb":897,"num_write":705,"num_write_kb":1089454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"153'781","reported_seq":1738,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728965+0000","last_change":"2023-12-06T15:30:17.617011+0000","last_active":"2023-12-06T16:28:53.728965+0000","last_peered":"2023-12-06T16:28:53.728965+0000","last_clean":"2023-12-06T16:28:53.728965+0000","last_became_active":"2023-12-06T15:25:48.206906+0000","last_became_peered":"2023-12-06T15:25:48.206906+0000","last_unstale":"2023-12-06T16:28:53.728965+0000","last_undegraded":"2023-12-06T16:28:53.728965+0000","last_fullsized":"2023-12-06T16:28:53.728965+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":781,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":40385513,"num_objects":26,"num_object_clones":1,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":771,"num_read_kb":4540,"num_write":652,"num_write_kb":964008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"153'3349","reported_seq":8242,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728490+0000","last_change":"2023-12-06T15:30:17.622402+0000","last_active":"2023-12-06T16:28:53.728490+0000","last_peered":"2023-12-06T16:28:53.728490+0000","last_clean":"2023-12-06T16:28:53.728490+0000","last_became_active":"2023-12-06T15:25:54.220756+0000","last_became_peered":"2023-12-06T15:25:54.220756+0000","last_unstale":"2023-12-06T16:28:53.728490+0000","last_undegraded":"2023-12-06T16:28:53.728490+0000","last_fullsized":"2023-12-06T16:28:53.728490+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":3349,"ondisk_log_size":3349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51299121,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":38,"num_read":12130,"num_read_kb":27934,"num_write":2245,"num_write_kb":1738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":719,"num_flush":173,"num_flush_kb":6205,"num_evict":482,"num_evict_kb":39117,"num_promote":533,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"156'1396","reported_seq":2355,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:32:50.626766+0000","last_change":"2023-12-06T18:32:50.626766+0000","last_active":"2023-12-06T18:32:50.626766+0000","last_peered":"2023-12-06T18:32:50.626766+0000","last_clean":"2023-12-06T18:32:50.626766+0000","last_became_active":"2023-12-06T15:25:48.204290+0000","last_became_peered":"2023-12-06T15:25:48.204290+0000","last_unstale":"2023-12-06T18:32:50.626766+0000","last_undegraded":"2023-12-06T18:32:50.626766+0000","last_fullsized":"2023-12-06T18:32:50.626766+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'1396","last_scrub_stamp":"2023-12-06T18:32:50.626638+0000","last_deep_scrub":"156'1396","last_deep_scrub_stamp":"2023-12-06T18:32:50.626638+0000","last_clean_scrub_stamp":"2023-12-06T18:32:50.626638+0000","log_size":1396,"ondisk_log_size":1396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":73011320,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":688,"num_read_kb":4922,"num_write":819,"num_write_kb":1094364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"153'3641","reported_seq":9475,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728910+0000","last_change":"2023-12-06T15:30:17.620567+0000","last_active":"2023-12-06T16:28:53.728910+0000","last_peered":"2023-12-06T16:28:53.728910+0000","last_clean":"2023-12-06T16:28:53.728910+0000","last_became_active":"2023-12-06T15:25:54.223136+0000","last_became_peered":"2023-12-06T15:25:54.223136+0000","last_unstale":"2023-12-06T16:28:53.728910+0000","last_undegraded":"2023-12-06T16:28:53.728910+0000","last_fullsized":"2023-12-06T16:28:53.728910+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":3641,"ondisk_log_size":3641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11076424,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":42,"num_read":10502,"num_read_kb":28911,"num_write":1839,"num_write_kb":767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":805,"num_flush":189,"num_flush_kb":1977,"num_evict":486,"num_evict_kb":35620,"num_promote":533,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":150,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728781+0000","last_change":"2023-12-06T15:25:48.207167+0000","last_active":"2023-12-06T16:28:53.728781+0000","last_peered":"2023-12-06T16:28:53.728781+0000","last_clean":"2023-12-06T16:28:53.728781+0000","last_became_active":"2023-12-06T15:25:48.206870+0000","last_became_peered":"2023-12-06T15:25:48.206870+0000","last_unstale":"2023-12-06T16:28:53.728781+0000","last_undegraded":"2023-12-06T16:28:53.728781+0000","last_fullsized":"2023-12-06T16:28:53.728781+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"153'1386","reported_seq":2258,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729136+0000","last_change":"2023-12-06T15:30:17.616899+0000","last_active":"2023-12-06T16:28:53.729136+0000","last_peered":"2023-12-06T16:28:53.729136+0000","last_clean":"2023-12-06T16:28:53.729136+0000","last_became_active":"2023-12-06T15:25:48.205750+0000","last_became_peered":"2023-12-06T15:25:48.205750+0000","last_unstale":"2023-12-06T16:28:53.729136+0000","last_undegraded":"2023-12-06T16:28:53.729136+0000","last_fullsized":"2023-12-06T16:28:53.729136+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":1386,"ondisk_log_size":1386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":91811925,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":601,"num_read_kb":4028,"num_write":820,"num_write_kb":1199092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"153'6456","reported_seq":14785,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728858+0000","last_change":"2023-12-06T15:30:17.621570+0000","last_active":"2023-12-06T16:28:53.728858+0000","last_peered":"2023-12-06T16:28:53.728858+0000","last_clean":"2023-12-06T16:28:53.728858+0000","last_became_active":"2023-12-06T15:25:54.221489+0000","last_became_peered":"2023-12-06T15:25:54.221489+0000","last_unstale":"2023-12-06T16:28:53.728858+0000","last_undegraded":"2023-12-06T16:28:53.728858+0000","last_fullsized":"2023-12-06T16:28:53.728858+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":6456,"ondisk_log_size":6456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":42890638,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":35,"num_read":24199,"num_read_kb":36879,"num_write":5231,"num_write_kb":3994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1414,"num_flush":231,"num_flush_kb":8685,"num_evict":509,"num_evict_kb":32296,"num_promote":556,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"156'926","reported_seq":1809,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:32:57.697314+0000","last_change":"2023-12-06T18:32:57.697314+0000","last_active":"2023-12-06T18:32:57.697314+0000","last_peered":"2023-12-06T18:32:57.697314+0000","last_clean":"2023-12-06T18:32:57.697314+0000","last_became_active":"2023-12-06T15:25:48.205967+0000","last_became_peered":"2023-12-06T15:25:48.205967+0000","last_unstale":"2023-12-06T18:32:57.697314+0000","last_undegraded":"2023-12-06T18:32:57.697314+0000","last_fullsized":"2023-12-06T18:32:57.697314+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'926","last_scrub_stamp":"2023-12-06T18:32:57.697195+0000","last_deep_scrub":"156'926","last_deep_scrub_stamp":"2023-12-06T18:32:57.697195+0000","last_clean_scrub_stamp":"2023-12-06T18:32:57.697195+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":113639590,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":664,"num_read_kb":403,"num_write":770,"num_write_kb":1081998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"153'4090","reported_seq":11085,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728527+0000","last_change":"2023-12-06T15:30:17.622674+0000","last_active":"2023-12-06T16:28:53.728527+0000","last_peered":"2023-12-06T16:28:53.728527+0000","last_clean":"2023-12-06T16:28:53.728527+0000","last_became_active":"2023-12-06T15:25:54.221304+0000","last_became_peered":"2023-12-06T15:25:54.221304+0000","last_unstale":"2023-12-06T16:28:53.728527+0000","last_undegraded":"2023-12-06T16:28:53.728527+0000","last_fullsized":"2023-12-06T16:28:53.728527+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":4090,"ondisk_log_size":4090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":41243290,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":40,"num_read":13526,"num_read_kb":30612,"num_write":2847,"num_write_kb":2055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":666,"num_flush":206,"num_flush_kb":5227,"num_evict":428,"num_evict_kb":30690,"num_promote":479,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"153'1069","reported_seq":1936,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728491+0000","last_change":"2023-12-06T15:30:17.621662+0000","last_active":"2023-12-06T16:28:53.728491+0000","last_peered":"2023-12-06T16:28:53.728491+0000","last_clean":"2023-12-06T16:28:53.728491+0000","last_became_active":"2023-12-06T15:25:48.204147+0000","last_became_peered":"2023-12-06T15:25:48.204147+0000","last_unstale":"2023-12-06T16:28:53.728491+0000","last_undegraded":"2023-12-06T16:28:53.728491+0000","last_fullsized":"2023-12-06T16:28:53.728491+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":1069,"ondisk_log_size":1069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127537306,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":556,"num_read_kb":811,"num_write":921,"num_write_kb":1173359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"153'871","reported_seq":1776,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728908+0000","last_change":"2023-12-06T15:30:17.620795+0000","last_active":"2023-12-06T16:28:53.728908+0000","last_peered":"2023-12-06T16:28:53.728908+0000","last_clean":"2023-12-06T16:28:53.728908+0000","last_became_active":"2023-12-06T15:25:48.204913+0000","last_became_peered":"2023-12-06T15:25:48.204913+0000","last_unstale":"2023-12-06T16:28:53.728908+0000","last_undegraded":"2023-12-06T16:28:53.728908+0000","last_fullsized":"2023-12-06T16:28:53.728908+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":871,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":43483484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":604,"num_read_kb":608,"num_write":703,"num_write_kb":1043763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":146509473,"num_objects":216,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":155,"num_read":60357,"num_read_kb":124336,"num_write":12162,"num_write_kb":8554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":16,"num_bytes_hit_set_archive":3604,"num_flush":799,"num_flush_kb":22094,"num_evict":1905,"num_evict_kb":137723,"num_promote":2101,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":187801600,"data_stored":187645250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17536,"ondisk_log_size":17536,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":644057897,"num_objects":264,"num_object_clones":2,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264,"num_whiteouts":2,"num_read":5281,"num_read_kb":19002,"num_write":6262,"num_write_kb":8828450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":271777792,"data_stored":271513170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8274,"ondisk_log_size":8274,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740638,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":444440,"kb_used_data":134928,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93927400,"statfs":{"total":96636764160,"available":96181657600,"internally_reserved":0,"allocated":138166272,"data_stored":137425212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 18:34:07 2023","interfaces":[{"interface":"back","average":{"1min":0.245,"5min":0.23400000000000001,"15min":0.23200000000000001},"min":{"1min":0.182,"5min":0.13800000000000001,"15min":0.13800000000000001},"max":{"1min":0.41799999999999998,"5min":0.42499999999999999,"15min":0.441},"last":0.21099999999999999},{"interface":"front","average":{"1min":0.23699999999999999,"5min":0.23499999999999999,"15min":0.23699999999999999},"min":{"1min":0.183,"5min":0.155,"15min":0.155},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.46100000000000002},"last":0.16800000000000001}]},{"osd":1,"last update":"Wed Dec 6 18:34:07 2023","interfaces":[{"interface":"back","average":{"1min":0.25600000000000001,"5min":0.247,"15min":0.25},"min":{"1min":0.187,"5min":0.16,"15min":0.16},"max":{"1min":0.45000000000000001,"5min":0.45400000000000001,"15min":0.48799999999999999},"last":0.191},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.27000000000000002,"15min":0.27500000000000002},"min":{"1min":0.22600000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.48899999999999999},"last":0.23300000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740637,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":468184,"kb_used_data":158672,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93903656,"statfs":{"total":96636764160,"available":96157343744,"internally_reserved":0,"allocated":162480128,"data_stored":161733705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 18:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.17799999999999999,"5min":0.19900000000000001,"15min":0.20999999999999999},"min":{"1min":0.13900000000000001,"5min":0.13600000000000001,"15min":0.13200000000000001},"max":{"1min":0.25800000000000001,"5min":0.379,"15min":0.45000000000000001},"last":0.17599999999999999},{"interface":"front","average":{"1min":0.23699999999999999,"5min":0.252,"15min":0.254},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.159},"max":{"1min":0.33100000000000002,"5min":0.44700000000000001,"15min":0.46100000000000002},"last":0.22700000000000001}]},{"osd":2,"last update":"Wed Dec 6 18:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.219,"15min":0.223},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.152},"max":{"1min":0.29799999999999999,"5min":0.40999999999999998,"15min":0.43099999999999999},"last":0.20999999999999999},{"interface":"front","average":{"1min":0.22,"5min":0.23100000000000001,"15min":0.23599999999999999},"min":{"1min":0.19600000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.318,"5min":0.41599999999999998,"15min":0.48399999999999999},"last":0.217}]}]},{"osd":1,"up_from":8,"seq":34359740638,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":468580,"kb_used_data":159068,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93903260,"statfs":{"total":96636764160,"available":96156938240,"internally_reserved":0,"allocated":162885632,"data_stored":162075943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 18:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.182,"5min":0.19900000000000001,"15min":0.20699999999999999},"min":{"1min":0.153,"5min":0.13400000000000001,"15min":0.13400000000000001},"max":{"1min":0.23899999999999999,"5min":0.40999999999999998,"15min":0.46600000000000003},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.24399999999999999,"5min":0.25900000000000001,"15min":0.26500000000000001},"min":{"1min":0.215,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.314,"5min":0.46800000000000003,"15min":0.48699999999999999},"last":0.28100000000000003}]},{"osd":2,"last update":"Wed Dec 6 18:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.23599999999999999,"15min":0.23499999999999999},"min":{"1min":0.186,"5min":0.182,"15min":0.16700000000000001},"max":{"1min":0.28699999999999998,"5min":0.443,"15min":0.443},"last":0.215},{"interface":"front","average":{"1min":0.23899999999999999,"5min":0.248,"15min":0.246},"min":{"1min":0.19900000000000001,"5min":0.17299999999999999,"15min":0.17000000000000001},"max":{"1min":0.28100000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.249}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":92942336,"data_stored":92846518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":135888896,"data_stored":135756585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":42946560,"data_stored":42910067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68222976,"data_stored":68195787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25677824,"data_stored":25626838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":93900800,"data_stored":93822625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T18:34:29.832 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:29.832 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:29.832 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:29.832 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:29.832 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:29.832 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:29.833 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:29.833 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:29.833 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:29.833 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:29.833 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:29.833 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T18:34:29.897 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:29.894+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:30.738 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:30.735+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:30.893 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:30.890+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:31.784 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:31.781+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:31.901 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:31.897+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:32.766 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:32.763+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:32.950 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:32.947+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:33.741 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:33.738+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:33.944 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:33.941+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:34.767 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:34.764+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:34.954 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:34.950+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:35.778 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:35.775+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:36.004 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:36.000+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:36.781 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:36.778+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:36.971 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:36.967+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:37.734 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:37.731+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:37.928 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:37.925+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:38.698 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:38.695+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:38.972 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:38.969+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:39.747 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:39.743+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:39.971 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:39.967+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:40.700 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:40.696+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:40.945 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:40.941+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:41.700 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:41.696+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:41.901 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:41.897+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:42.685 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:42.681+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:42.903 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:42.899+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:43.649 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:43.644+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:43.882 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:43.878+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:44.695 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:44.691+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:44.896 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:44.891+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:45.671 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:45.667+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:45.869 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:45.865+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:46.722 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:46.718+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:46.887 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:46.883+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:47.707 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:47.703+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:47.865 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:47.861+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:48.681 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:48.677+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:48.888 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:48.885+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:49.715 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:49.712+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:49.834 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T18:34:49.926 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:49.923+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:50.163 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T18:34:50.165 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2023-12-06T18:34:50.177 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":5824,"stamp":"2023-12-06T18:34:48.816346+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":790567370,"num_objects":480,"num_object_clones":2,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":385,"num_whiteouts":157,"num_read":65638,"num_read_kb":143338,"num_write":18424,"num_write_kb":8837004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":16,"num_bytes_hit_set_archive":3604,"num_flush":799,"num_flush_kb":22094,"num_evict":1905,"num_evict_kb":137723,"num_promote":2101,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25810,"ondisk_log_size":25810,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1381204,"kb_used_data":452668,"kb_used_omap":0,"kb_used_meta":928512,"kb_avail":281734316,"statfs":{"total":289910292480,"available":288495939584,"internally_reserved":0,"allocated":463532032,"data_stored":461234860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":950796288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002108"},"pg_stats":[{"pgid":"2.7","version":"153'998","reported_seq":1985,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729083+0000","last_change":"2023-12-06T15:30:17.617146+0000","last_active":"2023-12-06T16:28:53.729083+0000","last_peered":"2023-12-06T16:28:53.729083+0000","last_clean":"2023-12-06T16:28:53.729083+0000","last_became_active":"2023-12-06T15:25:48.206888+0000","last_became_peered":"2023-12-06T15:25:48.206888+0000","last_unstale":"2023-12-06T16:28:53.729083+0000","last_undegraded":"2023-12-06T16:28:53.729083+0000","last_fullsized":"2023-12-06T16:28:53.729083+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":998,"ondisk_log_size":998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":106983625,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":814,"num_read_kb":2793,"num_write":872,"num_write_kb":1182412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"153'847","reported_seq":1720,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729016+0000","last_change":"2023-12-06T15:30:17.617250+0000","last_active":"2023-12-06T16:28:53.729016+0000","last_peered":"2023-12-06T16:28:53.729016+0000","last_clean":"2023-12-06T16:28:53.729016+0000","last_became_active":"2023-12-06T15:25:48.206986+0000","last_became_peered":"2023-12-06T15:25:48.206986+0000","last_unstale":"2023-12-06T16:28:53.729016+0000","last_undegraded":"2023-12-06T16:28:53.729016+0000","last_fullsized":"2023-12-06T16:28:53.729016+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":847,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":47205134,"num_objects":21,"num_object_clones":1,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":1,"num_read":583,"num_read_kb":897,"num_write":705,"num_write_kb":1089454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"153'781","reported_seq":1738,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728965+0000","last_change":"2023-12-06T15:30:17.617011+0000","last_active":"2023-12-06T16:28:53.728965+0000","last_peered":"2023-12-06T16:28:53.728965+0000","last_clean":"2023-12-06T16:28:53.728965+0000","last_became_active":"2023-12-06T15:25:48.206906+0000","last_became_peered":"2023-12-06T15:25:48.206906+0000","last_unstale":"2023-12-06T16:28:53.728965+0000","last_undegraded":"2023-12-06T16:28:53.728965+0000","last_fullsized":"2023-12-06T16:28:53.728965+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":781,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":40385513,"num_objects":26,"num_object_clones":1,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":771,"num_read_kb":4540,"num_write":652,"num_write_kb":964008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"153'3349","reported_seq":8242,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728490+0000","last_change":"2023-12-06T15:30:17.622402+0000","last_active":"2023-12-06T16:28:53.728490+0000","last_peered":"2023-12-06T16:28:53.728490+0000","last_clean":"2023-12-06T16:28:53.728490+0000","last_became_active":"2023-12-06T15:25:54.220756+0000","last_became_peered":"2023-12-06T15:25:54.220756+0000","last_unstale":"2023-12-06T16:28:53.728490+0000","last_undegraded":"2023-12-06T16:28:53.728490+0000","last_fullsized":"2023-12-06T16:28:53.728490+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":3349,"ondisk_log_size":3349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51299121,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":38,"num_read":12130,"num_read_kb":27934,"num_write":2245,"num_write_kb":1738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":719,"num_flush":173,"num_flush_kb":6205,"num_evict":482,"num_evict_kb":39117,"num_promote":533,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"156'1396","reported_seq":2355,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:32:50.626766+0000","last_change":"2023-12-06T18:32:50.626766+0000","last_active":"2023-12-06T18:32:50.626766+0000","last_peered":"2023-12-06T18:32:50.626766+0000","last_clean":"2023-12-06T18:32:50.626766+0000","last_became_active":"2023-12-06T15:25:48.204290+0000","last_became_peered":"2023-12-06T15:25:48.204290+0000","last_unstale":"2023-12-06T18:32:50.626766+0000","last_undegraded":"2023-12-06T18:32:50.626766+0000","last_fullsized":"2023-12-06T18:32:50.626766+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'1396","last_scrub_stamp":"2023-12-06T18:32:50.626638+0000","last_deep_scrub":"156'1396","last_deep_scrub_stamp":"2023-12-06T18:32:50.626638+0000","last_clean_scrub_stamp":"2023-12-06T18:32:50.626638+0000","log_size":1396,"ondisk_log_size":1396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":73011320,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":688,"num_read_kb":4922,"num_write":819,"num_write_kb":1094364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"153'3641","reported_seq":9475,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728910+0000","last_change":"2023-12-06T15:30:17.620567+0000","last_active":"2023-12-06T16:28:53.728910+0000","last_peered":"2023-12-06T16:28:53.728910+0000","last_clean":"2023-12-06T16:28:53.728910+0000","last_became_active":"2023-12-06T15:25:54.223136+0000","last_became_peered":"2023-12-06T15:25:54.223136+0000","last_unstale":"2023-12-06T16:28:53.728910+0000","last_undegraded":"2023-12-06T16:28:53.728910+0000","last_fullsized":"2023-12-06T16:28:53.728910+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":3641,"ondisk_log_size":3641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11076424,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":42,"num_read":10502,"num_read_kb":28911,"num_write":1839,"num_write_kb":767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":805,"num_flush":189,"num_flush_kb":1977,"num_evict":486,"num_evict_kb":35620,"num_promote":533,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":150,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728781+0000","last_change":"2023-12-06T15:25:48.207167+0000","last_active":"2023-12-06T16:28:53.728781+0000","last_peered":"2023-12-06T16:28:53.728781+0000","last_clean":"2023-12-06T16:28:53.728781+0000","last_became_active":"2023-12-06T15:25:48.206870+0000","last_became_peered":"2023-12-06T15:25:48.206870+0000","last_unstale":"2023-12-06T16:28:53.728781+0000","last_undegraded":"2023-12-06T16:28:53.728781+0000","last_fullsized":"2023-12-06T16:28:53.728781+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"153'1386","reported_seq":2258,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729136+0000","last_change":"2023-12-06T15:30:17.616899+0000","last_active":"2023-12-06T16:28:53.729136+0000","last_peered":"2023-12-06T16:28:53.729136+0000","last_clean":"2023-12-06T16:28:53.729136+0000","last_became_active":"2023-12-06T15:25:48.205750+0000","last_became_peered":"2023-12-06T15:25:48.205750+0000","last_unstale":"2023-12-06T16:28:53.729136+0000","last_undegraded":"2023-12-06T16:28:53.729136+0000","last_fullsized":"2023-12-06T16:28:53.729136+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":1386,"ondisk_log_size":1386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":91811925,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":601,"num_read_kb":4028,"num_write":820,"num_write_kb":1199092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"153'6456","reported_seq":14785,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728858+0000","last_change":"2023-12-06T15:30:17.621570+0000","last_active":"2023-12-06T16:28:53.728858+0000","last_peered":"2023-12-06T16:28:53.728858+0000","last_clean":"2023-12-06T16:28:53.728858+0000","last_became_active":"2023-12-06T15:25:54.221489+0000","last_became_peered":"2023-12-06T15:25:54.221489+0000","last_unstale":"2023-12-06T16:28:53.728858+0000","last_undegraded":"2023-12-06T16:28:53.728858+0000","last_fullsized":"2023-12-06T16:28:53.728858+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":6456,"ondisk_log_size":6456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":42890638,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":35,"num_read":24199,"num_read_kb":36879,"num_write":5231,"num_write_kb":3994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1414,"num_flush":231,"num_flush_kb":8685,"num_evict":509,"num_evict_kb":32296,"num_promote":556,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"156'926","reported_seq":1809,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:32:57.697314+0000","last_change":"2023-12-06T18:32:57.697314+0000","last_active":"2023-12-06T18:32:57.697314+0000","last_peered":"2023-12-06T18:32:57.697314+0000","last_clean":"2023-12-06T18:32:57.697314+0000","last_became_active":"2023-12-06T15:25:48.205967+0000","last_became_peered":"2023-12-06T15:25:48.205967+0000","last_unstale":"2023-12-06T18:32:57.697314+0000","last_undegraded":"2023-12-06T18:32:57.697314+0000","last_fullsized":"2023-12-06T18:32:57.697314+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'926","last_scrub_stamp":"2023-12-06T18:32:57.697195+0000","last_deep_scrub":"156'926","last_deep_scrub_stamp":"2023-12-06T18:32:57.697195+0000","last_clean_scrub_stamp":"2023-12-06T18:32:57.697195+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":113639590,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":664,"num_read_kb":403,"num_write":770,"num_write_kb":1081998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"153'4090","reported_seq":11085,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728527+0000","last_change":"2023-12-06T15:30:17.622674+0000","last_active":"2023-12-06T16:28:53.728527+0000","last_peered":"2023-12-06T16:28:53.728527+0000","last_clean":"2023-12-06T16:28:53.728527+0000","last_became_active":"2023-12-06T15:25:54.221304+0000","last_became_peered":"2023-12-06T15:25:54.221304+0000","last_unstale":"2023-12-06T16:28:53.728527+0000","last_undegraded":"2023-12-06T16:28:53.728527+0000","last_fullsized":"2023-12-06T16:28:53.728527+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":4090,"ondisk_log_size":4090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":41243290,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":40,"num_read":13526,"num_read_kb":30612,"num_write":2847,"num_write_kb":2055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":666,"num_flush":206,"num_flush_kb":5227,"num_evict":428,"num_evict_kb":30690,"num_promote":479,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"153'1069","reported_seq":1936,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728491+0000","last_change":"2023-12-06T15:30:17.621662+0000","last_active":"2023-12-06T16:28:53.728491+0000","last_peered":"2023-12-06T16:28:53.728491+0000","last_clean":"2023-12-06T16:28:53.728491+0000","last_became_active":"2023-12-06T15:25:48.204147+0000","last_became_peered":"2023-12-06T15:25:48.204147+0000","last_unstale":"2023-12-06T16:28:53.728491+0000","last_undegraded":"2023-12-06T16:28:53.728491+0000","last_fullsized":"2023-12-06T16:28:53.728491+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":1069,"ondisk_log_size":1069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127537306,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":556,"num_read_kb":811,"num_write":921,"num_write_kb":1173359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"153'871","reported_seq":1776,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728908+0000","last_change":"2023-12-06T15:30:17.620795+0000","last_active":"2023-12-06T16:28:53.728908+0000","last_peered":"2023-12-06T16:28:53.728908+0000","last_clean":"2023-12-06T16:28:53.728908+0000","last_became_active":"2023-12-06T15:25:48.204913+0000","last_became_peered":"2023-12-06T15:25:48.204913+0000","last_unstale":"2023-12-06T16:28:53.728908+0000","last_undegraded":"2023-12-06T16:28:53.728908+0000","last_fullsized":"2023-12-06T16:28:53.728908+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":871,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":43483484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":604,"num_read_kb":608,"num_write":703,"num_write_kb":1043763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":146509473,"num_objects":216,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":155,"num_read":60357,"num_read_kb":124336,"num_write":12162,"num_write_kb":8554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":16,"num_bytes_hit_set_archive":3604,"num_flush":799,"num_flush_kb":22094,"num_evict":1905,"num_evict_kb":137723,"num_promote":2101,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":187801600,"data_stored":187645250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17536,"ondisk_log_size":17536,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":644057897,"num_objects":264,"num_object_clones":2,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264,"num_whiteouts":2,"num_read":5281,"num_read_kb":19002,"num_write":6262,"num_write_kb":8828450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":271777792,"data_stored":271513170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8274,"ondisk_log_size":8274,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740642,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":444440,"kb_used_data":134928,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93927400,"statfs":{"total":96636764160,"available":96181657600,"internally_reserved":0,"allocated":138166272,"data_stored":137425212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 18:34:07 2023","interfaces":[{"interface":"back","average":{"1min":0.245,"5min":0.23400000000000001,"15min":0.23200000000000001},"min":{"1min":0.182,"5min":0.13800000000000001,"15min":0.13800000000000001},"max":{"1min":0.41799999999999998,"5min":0.42499999999999999,"15min":0.441},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.23699999999999999,"5min":0.23499999999999999,"15min":0.23699999999999999},"min":{"1min":0.183,"5min":0.155,"15min":0.155},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.46100000000000002},"last":0.21299999999999999}]},{"osd":1,"last update":"Wed Dec 6 18:34:07 2023","interfaces":[{"interface":"back","average":{"1min":0.25600000000000001,"5min":0.247,"15min":0.25},"min":{"1min":0.187,"5min":0.16,"15min":0.16},"max":{"1min":0.45000000000000001,"5min":0.45400000000000001,"15min":0.48799999999999999},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.27000000000000002,"15min":0.27500000000000002},"min":{"1min":0.22600000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.48899999999999999},"last":0.26000000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740641,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":468184,"kb_used_data":158672,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93903656,"statfs":{"total":96636764160,"available":96157343744,"internally_reserved":0,"allocated":162480128,"data_stored":161733705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 18:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.17799999999999999,"5min":0.19900000000000001,"15min":0.20999999999999999},"min":{"1min":0.13900000000000001,"5min":0.13600000000000001,"15min":0.13200000000000001},"max":{"1min":0.25800000000000001,"5min":0.379,"15min":0.45000000000000001},"last":0.253},{"interface":"front","average":{"1min":0.23699999999999999,"5min":0.252,"15min":0.254},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.159},"max":{"1min":0.33100000000000002,"5min":0.44700000000000001,"15min":0.46100000000000002},"last":0.246}]},{"osd":2,"last update":"Wed Dec 6 18:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.219,"15min":0.223},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.152},"max":{"1min":0.29799999999999999,"5min":0.40999999999999998,"15min":0.43099999999999999},"last":0.20499999999999999},{"interface":"front","average":{"1min":0.22,"5min":0.23100000000000001,"15min":0.23599999999999999},"min":{"1min":0.19600000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.318,"5min":0.41599999999999998,"15min":0.48399999999999999},"last":0.22600000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740642,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":468580,"kb_used_data":159068,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93903260,"statfs":{"total":96636764160,"available":96156938240,"internally_reserved":0,"allocated":162885632,"data_stored":162075943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 18:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.182,"5min":0.19900000000000001,"15min":0.20699999999999999},"min":{"1min":0.153,"5min":0.13400000000000001,"15min":0.13400000000000001},"max":{"1min":0.23899999999999999,"5min":0.40999999999999998,"15min":0.46600000000000003},"last":0.17299999999999999},{"interface":"front","average":{"1min":0.24399999999999999,"5min":0.25900000000000001,"15min":0.26500000000000001},"min":{"1min":0.215,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.314,"5min":0.46800000000000003,"15min":0.48699999999999999},"last":0.26000000000000001}]},{"osd":2,"last update":"Wed Dec 6 18:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.23599999999999999,"15min":0.23499999999999999},"min":{"1min":0.186,"5min":0.182,"15min":0.16700000000000001},"max":{"1min":0.28699999999999998,"5min":0.443,"15min":0.443},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.23899999999999999,"5min":0.248,"15min":0.246},"min":{"1min":0.19900000000000001,"5min":0.17299999999999999,"15min":0.17000000000000001},"max":{"1min":0.28100000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.22500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":92942336,"data_stored":92846518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":135888896,"data_stored":135756585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":42946560,"data_stored":42910067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68222976,"data_stored":68195787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25677824,"data_stored":25626838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":93900800,"data_stored":93822625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T18:34:50.178 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:50.179 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:50.179 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:50.179 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:50.179 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:50.179 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:50.179 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:50.180 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:50.180 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:50.180 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:50.180 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:34:50.180 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T18:34:50.679 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:50.676+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:50.886 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:50.883+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:51.676 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:51.672+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:51.849 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:51.845+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:52.707 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:52.704+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:52.827 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:52.823+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:53.697 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:53.693+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:53.856 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:53.853+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:54.747 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:54.744+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:54.833 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:54.829+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:55.755 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:55.752+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:55.882 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:55.878+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:56.737 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:56.734+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:56.879 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:56.876+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:57.730 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:57.727+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:57.901 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:57.897+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:58.759 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:58.756+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:58.853 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:58.850+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:34:59.743 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:34:59.739+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:34:59.902 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:34:59.899+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:00.713 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:00.710+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:00.903 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:00.900+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:01.678 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:01.675+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:01.883 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:01.880+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:02.715 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:02.712+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:02.885 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:02.881+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:03.701 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:03.698+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:03.882 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:03.879+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:04.749 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:04.746+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:04.895 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:04.891+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:05.753 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:05.748+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:05.930 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:05.927+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:06.715 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:06.712+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:06.911 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:06.908+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:07.753 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:07.750+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:07.921 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:07.918+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:08.723 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:08.720+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:08.909 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:08.905+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:09.747 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:09.744+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:09.882 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:09.878+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:10.181 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T18:35:10.480 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T18:35:10.482 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2023-12-06T18:35:10.493 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":5834,"stamp":"2023-12-06T18:35:08.819437+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":790567370,"num_objects":480,"num_object_clones":2,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":385,"num_whiteouts":157,"num_read":65638,"num_read_kb":143338,"num_write":18424,"num_write_kb":8837004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":16,"num_bytes_hit_set_archive":3604,"num_flush":799,"num_flush_kb":22094,"num_evict":1905,"num_evict_kb":137723,"num_promote":2101,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25810,"ondisk_log_size":25810,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1381204,"kb_used_data":452668,"kb_used_omap":0,"kb_used_meta":928512,"kb_avail":281734316,"statfs":{"total":289910292480,"available":288495939584,"internally_reserved":0,"allocated":463532032,"data_stored":461234860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":950796288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001914"},"pg_stats":[{"pgid":"2.7","version":"153'998","reported_seq":1985,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729083+0000","last_change":"2023-12-06T15:30:17.617146+0000","last_active":"2023-12-06T16:28:53.729083+0000","last_peered":"2023-12-06T16:28:53.729083+0000","last_clean":"2023-12-06T16:28:53.729083+0000","last_became_active":"2023-12-06T15:25:48.206888+0000","last_became_peered":"2023-12-06T15:25:48.206888+0000","last_unstale":"2023-12-06T16:28:53.729083+0000","last_undegraded":"2023-12-06T16:28:53.729083+0000","last_fullsized":"2023-12-06T16:28:53.729083+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":998,"ondisk_log_size":998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":106983625,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":814,"num_read_kb":2793,"num_write":872,"num_write_kb":1182412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"153'847","reported_seq":1720,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729016+0000","last_change":"2023-12-06T15:30:17.617250+0000","last_active":"2023-12-06T16:28:53.729016+0000","last_peered":"2023-12-06T16:28:53.729016+0000","last_clean":"2023-12-06T16:28:53.729016+0000","last_became_active":"2023-12-06T15:25:48.206986+0000","last_became_peered":"2023-12-06T15:25:48.206986+0000","last_unstale":"2023-12-06T16:28:53.729016+0000","last_undegraded":"2023-12-06T16:28:53.729016+0000","last_fullsized":"2023-12-06T16:28:53.729016+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":847,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":47205134,"num_objects":21,"num_object_clones":1,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":1,"num_read":583,"num_read_kb":897,"num_write":705,"num_write_kb":1089454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"153'781","reported_seq":1738,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728965+0000","last_change":"2023-12-06T15:30:17.617011+0000","last_active":"2023-12-06T16:28:53.728965+0000","last_peered":"2023-12-06T16:28:53.728965+0000","last_clean":"2023-12-06T16:28:53.728965+0000","last_became_active":"2023-12-06T15:25:48.206906+0000","last_became_peered":"2023-12-06T15:25:48.206906+0000","last_unstale":"2023-12-06T16:28:53.728965+0000","last_undegraded":"2023-12-06T16:28:53.728965+0000","last_fullsized":"2023-12-06T16:28:53.728965+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":781,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":40385513,"num_objects":26,"num_object_clones":1,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":771,"num_read_kb":4540,"num_write":652,"num_write_kb":964008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"153'3349","reported_seq":8242,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728490+0000","last_change":"2023-12-06T15:30:17.622402+0000","last_active":"2023-12-06T16:28:53.728490+0000","last_peered":"2023-12-06T16:28:53.728490+0000","last_clean":"2023-12-06T16:28:53.728490+0000","last_became_active":"2023-12-06T15:25:54.220756+0000","last_became_peered":"2023-12-06T15:25:54.220756+0000","last_unstale":"2023-12-06T16:28:53.728490+0000","last_undegraded":"2023-12-06T16:28:53.728490+0000","last_fullsized":"2023-12-06T16:28:53.728490+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":3349,"ondisk_log_size":3349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51299121,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":38,"num_read":12130,"num_read_kb":27934,"num_write":2245,"num_write_kb":1738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":719,"num_flush":173,"num_flush_kb":6205,"num_evict":482,"num_evict_kb":39117,"num_promote":533,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"156'1396","reported_seq":2355,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:32:50.626766+0000","last_change":"2023-12-06T18:32:50.626766+0000","last_active":"2023-12-06T18:32:50.626766+0000","last_peered":"2023-12-06T18:32:50.626766+0000","last_clean":"2023-12-06T18:32:50.626766+0000","last_became_active":"2023-12-06T15:25:48.204290+0000","last_became_peered":"2023-12-06T15:25:48.204290+0000","last_unstale":"2023-12-06T18:32:50.626766+0000","last_undegraded":"2023-12-06T18:32:50.626766+0000","last_fullsized":"2023-12-06T18:32:50.626766+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'1396","last_scrub_stamp":"2023-12-06T18:32:50.626638+0000","last_deep_scrub":"156'1396","last_deep_scrub_stamp":"2023-12-06T18:32:50.626638+0000","last_clean_scrub_stamp":"2023-12-06T18:32:50.626638+0000","log_size":1396,"ondisk_log_size":1396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":73011320,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":688,"num_read_kb":4922,"num_write":819,"num_write_kb":1094364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"153'3641","reported_seq":9475,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728910+0000","last_change":"2023-12-06T15:30:17.620567+0000","last_active":"2023-12-06T16:28:53.728910+0000","last_peered":"2023-12-06T16:28:53.728910+0000","last_clean":"2023-12-06T16:28:53.728910+0000","last_became_active":"2023-12-06T15:25:54.223136+0000","last_became_peered":"2023-12-06T15:25:54.223136+0000","last_unstale":"2023-12-06T16:28:53.728910+0000","last_undegraded":"2023-12-06T16:28:53.728910+0000","last_fullsized":"2023-12-06T16:28:53.728910+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":3641,"ondisk_log_size":3641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11076424,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":42,"num_read":10502,"num_read_kb":28911,"num_write":1839,"num_write_kb":767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":805,"num_flush":189,"num_flush_kb":1977,"num_evict":486,"num_evict_kb":35620,"num_promote":533,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":150,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728781+0000","last_change":"2023-12-06T15:25:48.207167+0000","last_active":"2023-12-06T16:28:53.728781+0000","last_peered":"2023-12-06T16:28:53.728781+0000","last_clean":"2023-12-06T16:28:53.728781+0000","last_became_active":"2023-12-06T15:25:48.206870+0000","last_became_peered":"2023-12-06T15:25:48.206870+0000","last_unstale":"2023-12-06T16:28:53.728781+0000","last_undegraded":"2023-12-06T16:28:53.728781+0000","last_fullsized":"2023-12-06T16:28:53.728781+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"153'1386","reported_seq":2258,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.729136+0000","last_change":"2023-12-06T15:30:17.616899+0000","last_active":"2023-12-06T16:28:53.729136+0000","last_peered":"2023-12-06T16:28:53.729136+0000","last_clean":"2023-12-06T16:28:53.729136+0000","last_became_active":"2023-12-06T15:25:48.205750+0000","last_became_peered":"2023-12-06T15:25:48.205750+0000","last_unstale":"2023-12-06T16:28:53.729136+0000","last_undegraded":"2023-12-06T16:28:53.729136+0000","last_fullsized":"2023-12-06T16:28:53.729136+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":1386,"ondisk_log_size":1386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":91811925,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":601,"num_read_kb":4028,"num_write":820,"num_write_kb":1199092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"153'6456","reported_seq":14785,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728858+0000","last_change":"2023-12-06T15:30:17.621570+0000","last_active":"2023-12-06T16:28:53.728858+0000","last_peered":"2023-12-06T16:28:53.728858+0000","last_clean":"2023-12-06T16:28:53.728858+0000","last_became_active":"2023-12-06T15:25:54.221489+0000","last_became_peered":"2023-12-06T15:25:54.221489+0000","last_unstale":"2023-12-06T16:28:53.728858+0000","last_undegraded":"2023-12-06T16:28:53.728858+0000","last_fullsized":"2023-12-06T16:28:53.728858+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":6456,"ondisk_log_size":6456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":42890638,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":35,"num_read":24199,"num_read_kb":36879,"num_write":5231,"num_write_kb":3994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1414,"num_flush":231,"num_flush_kb":8685,"num_evict":509,"num_evict_kb":32296,"num_promote":556,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"156'926","reported_seq":1809,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:32:57.697314+0000","last_change":"2023-12-06T18:32:57.697314+0000","last_active":"2023-12-06T18:32:57.697314+0000","last_peered":"2023-12-06T18:32:57.697314+0000","last_clean":"2023-12-06T18:32:57.697314+0000","last_became_active":"2023-12-06T15:25:48.205967+0000","last_became_peered":"2023-12-06T15:25:48.205967+0000","last_unstale":"2023-12-06T18:32:57.697314+0000","last_undegraded":"2023-12-06T18:32:57.697314+0000","last_fullsized":"2023-12-06T18:32:57.697314+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'926","last_scrub_stamp":"2023-12-06T18:32:57.697195+0000","last_deep_scrub":"156'926","last_deep_scrub_stamp":"2023-12-06T18:32:57.697195+0000","last_clean_scrub_stamp":"2023-12-06T18:32:57.697195+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":113639590,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":664,"num_read_kb":403,"num_write":770,"num_write_kb":1081998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"153'4090","reported_seq":11085,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728527+0000","last_change":"2023-12-06T15:30:17.622674+0000","last_active":"2023-12-06T16:28:53.728527+0000","last_peered":"2023-12-06T16:28:53.728527+0000","last_clean":"2023-12-06T16:28:53.728527+0000","last_became_active":"2023-12-06T15:25:54.221304+0000","last_became_peered":"2023-12-06T15:25:54.221304+0000","last_unstale":"2023-12-06T16:28:53.728527+0000","last_undegraded":"2023-12-06T16:28:53.728527+0000","last_fullsized":"2023-12-06T16:28:53.728527+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":4090,"ondisk_log_size":4090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":41243290,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":40,"num_read":13526,"num_read_kb":30612,"num_write":2847,"num_write_kb":2055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":666,"num_flush":206,"num_flush_kb":5227,"num_evict":428,"num_evict_kb":30690,"num_promote":479,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"153'1069","reported_seq":1936,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728491+0000","last_change":"2023-12-06T15:30:17.621662+0000","last_active":"2023-12-06T16:28:53.728491+0000","last_peered":"2023-12-06T16:28:53.728491+0000","last_clean":"2023-12-06T16:28:53.728491+0000","last_became_active":"2023-12-06T15:25:48.204147+0000","last_became_peered":"2023-12-06T15:25:48.204147+0000","last_unstale":"2023-12-06T16:28:53.728491+0000","last_undegraded":"2023-12-06T16:28:53.728491+0000","last_fullsized":"2023-12-06T16:28:53.728491+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":1069,"ondisk_log_size":1069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127537306,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":556,"num_read_kb":811,"num_write":921,"num_write_kb":1173359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"153'871","reported_seq":1776,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728908+0000","last_change":"2023-12-06T15:30:17.620795+0000","last_active":"2023-12-06T16:28:53.728908+0000","last_peered":"2023-12-06T16:28:53.728908+0000","last_clean":"2023-12-06T16:28:53.728908+0000","last_became_active":"2023-12-06T15:25:48.204913+0000","last_became_peered":"2023-12-06T15:25:48.204913+0000","last_unstale":"2023-12-06T16:28:53.728908+0000","last_undegraded":"2023-12-06T16:28:53.728908+0000","last_fullsized":"2023-12-06T16:28:53.728908+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:47.192717+0000","last_clean_scrub_stamp":"2023-12-06T15:25:47.192717+0000","log_size":871,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":43483484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":604,"num_read_kb":608,"num_write":703,"num_write_kb":1043763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":146509473,"num_objects":216,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":155,"num_read":60357,"num_read_kb":124336,"num_write":12162,"num_write_kb":8554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":16,"num_bytes_hit_set_archive":3604,"num_flush":799,"num_flush_kb":22094,"num_evict":1905,"num_evict_kb":137723,"num_promote":2101,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":187801600,"data_stored":187645250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17536,"ondisk_log_size":17536,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":644057897,"num_objects":264,"num_object_clones":2,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264,"num_whiteouts":2,"num_read":5281,"num_read_kb":19002,"num_write":6262,"num_write_kb":8828450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":271777792,"data_stored":271513170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8274,"ondisk_log_size":8274,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740646,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":444440,"kb_used_data":134928,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93927400,"statfs":{"total":96636764160,"available":96181657600,"internally_reserved":0,"allocated":138166272,"data_stored":137425212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 18:34:07 2023","interfaces":[{"interface":"back","average":{"1min":0.245,"5min":0.23400000000000001,"15min":0.23200000000000001},"min":{"1min":0.182,"5min":0.13800000000000001,"15min":0.13800000000000001},"max":{"1min":0.41799999999999998,"5min":0.42499999999999999,"15min":0.441},"last":0.253},{"interface":"front","average":{"1min":0.23699999999999999,"5min":0.23499999999999999,"15min":0.23699999999999999},"min":{"1min":0.183,"5min":0.155,"15min":0.155},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.46100000000000002},"last":0.21199999999999999}]},{"osd":1,"last update":"Wed Dec 6 18:34:07 2023","interfaces":[{"interface":"back","average":{"1min":0.25600000000000001,"5min":0.247,"15min":0.25},"min":{"1min":0.187,"5min":0.16,"15min":0.16},"max":{"1min":0.45000000000000001,"5min":0.45400000000000001,"15min":0.48799999999999999},"last":0.20499999999999999},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.27000000000000002,"15min":0.27500000000000002},"min":{"1min":0.22600000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.48899999999999999},"last":0.23400000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740645,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":468184,"kb_used_data":158672,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93903656,"statfs":{"total":96636764160,"available":96157343744,"internally_reserved":0,"allocated":162480128,"data_stored":161733705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 18:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.17799999999999999,"5min":0.19900000000000001,"15min":0.20999999999999999},"min":{"1min":0.13900000000000001,"5min":0.13600000000000001,"15min":0.13200000000000001},"max":{"1min":0.25800000000000001,"5min":0.379,"15min":0.45000000000000001},"last":0.16200000000000001},{"interface":"front","average":{"1min":0.23699999999999999,"5min":0.252,"15min":0.254},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.159},"max":{"1min":0.33100000000000002,"5min":0.44700000000000001,"15min":0.46100000000000002},"last":0.22700000000000001}]},{"osd":2,"last update":"Wed Dec 6 18:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.219,"15min":0.223},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.152},"max":{"1min":0.29799999999999999,"5min":0.40999999999999998,"15min":0.43099999999999999},"last":0.17199999999999999},{"interface":"front","average":{"1min":0.22,"5min":0.23100000000000001,"15min":0.23599999999999999},"min":{"1min":0.19600000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.318,"5min":0.41599999999999998,"15min":0.48399999999999999},"last":0.19500000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740646,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":468580,"kb_used_data":159068,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93903260,"statfs":{"total":96636764160,"available":96156938240,"internally_reserved":0,"allocated":162885632,"data_stored":162075943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 18:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.182,"5min":0.19900000000000001,"15min":0.20699999999999999},"min":{"1min":0.153,"5min":0.13400000000000001,"15min":0.13400000000000001},"max":{"1min":0.23899999999999999,"5min":0.40999999999999998,"15min":0.46600000000000003},"last":0.159},{"interface":"front","average":{"1min":0.24399999999999999,"5min":0.25900000000000001,"15min":0.26500000000000001},"min":{"1min":0.215,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.314,"5min":0.46800000000000003,"15min":0.48699999999999999},"last":0.218}]},{"osd":2,"last update":"Wed Dec 6 18:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.23599999999999999,"15min":0.23499999999999999},"min":{"1min":0.186,"5min":0.182,"15min":0.16700000000000001},"max":{"1min":0.28699999999999998,"5min":0.443,"15min":0.443},"last":0.189},{"interface":"front","average":{"1min":0.23899999999999999,"5min":0.248,"15min":0.246},"min":{"1min":0.19900000000000001,"5min":0.17299999999999999,"15min":0.17000000000000001},"max":{"1min":0.28100000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.22900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":92942336,"data_stored":92846518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":135888896,"data_stored":135756585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":42946560,"data_stored":42910067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68222976,"data_stored":68195787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25677824,"data_stored":25626838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":93900800,"data_stored":93822625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T18:35:10.494 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:35:10.494 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:35:10.494 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:35:10.494 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:35:10.494 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:35:10.495 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:35:10.495 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:35:10.495 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:35:10.495 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:35:10.495 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:35:10.495 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T15:25:47.192717+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=47, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:35:10.496 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-12-06T18:35:10.774 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:10.771+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:10.829 INFO:teuthology.orchestra.run.smithi123.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-12-06T18:35:10.839 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-12-06T18:35:10.847 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:10.844+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:11.191 INFO:teuthology.orchestra.run.smithi123.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-12-06T18:35:11.203 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-12-06T18:35:11.541 INFO:teuthology.orchestra.run.smithi123.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-12-06T18:35:11.553 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.1 2023-12-06T18:35:11.796 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:11.793+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:11.811 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:11.807+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:11.904 INFO:teuthology.orchestra.run.smithi123.stderr:instructing pg 3.1 on osd.0 to deep-scrub 2023-12-06T18:35:11.915 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2023-12-06T18:35:12.215 INFO:teuthology.orchestra.run.smithi123.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2023-12-06T18:35:12.225 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 1.0 2023-12-06T18:35:12.520 INFO:teuthology.orchestra.run.smithi123.stderr:instructing pg 1.0 on osd.1 to deep-scrub 2023-12-06T18:35:12.531 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.3 2023-12-06T18:35:12.822 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:12.819+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:12.839 INFO:teuthology.orchestra.run.smithi123.stderr:instructing pg 2.3 on osd.1 to deep-scrub 2023-12-06T18:35:12.850 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.0 2023-12-06T18:35:12.855 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:12.852+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:13.174 INFO:teuthology.orchestra.run.smithi123.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2023-12-06T18:35:13.185 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.3 2023-12-06T18:35:13.518 INFO:teuthology.orchestra.run.smithi123.stderr:instructing pg 3.3 on osd.0 to deep-scrub 2023-12-06T18:35:13.531 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.2 2023-12-06T18:35:13.828 INFO:teuthology.orchestra.run.smithi123.stderr:instructing pg 2.2 on osd.0 to deep-scrub 2023-12-06T18:35:13.838 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-12-06T18:35:13.842 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:13.839+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:13.863 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:13.859+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:14.169 INFO:teuthology.orchestra.run.smithi123.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-12-06T18:35:14.179 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T18:35:14.815 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:14.812+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:14.843 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:14.840+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:15.847 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:15.844+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:15.847 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:15.844+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:16.837 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:16.834+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:16.841 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:16.838+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:17.800 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:17.797+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:17.882 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:17.878+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:18.811 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:18.808+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:18.853 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:18.850+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:19.769 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:19.766+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:19.886 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:19.883+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:20.744 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:20.741+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:20.838 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:20.835+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:21.714 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:21.711+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:21.825 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:21.821+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:22.697 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:22.693+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:22.823 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:22.819+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:23.690 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:23.686+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:23.779 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:23.775+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:24.710 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:24.706+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:24.797 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:24.793+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:25.727 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:25.723+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:25.821 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:25.817+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:26.773 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:26.769+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:26.813 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:26.809+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:27.788 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:27.783+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:27.840 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:27.836+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:28.797 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:28.793+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:28.836 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:28.832+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:29.798 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:29.794+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:29.801 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:29.797+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:30.760 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:30.757+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:30.808 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:30.803+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:31.769 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:31.766+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:31.809 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:31.806+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:32.767 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:32.763+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:32.785 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:32.781+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:33.761 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:33.757+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:33.794 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:33.790+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:34.180 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T18:35:34.474 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T18:35:34.476 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2023-12-06T18:35:34.486 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":5846,"stamp":"2023-12-06T18:35:32.822740+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":790567370,"num_objects":480,"num_object_clones":2,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":385,"num_whiteouts":157,"num_read":65638,"num_read_kb":143338,"num_write":18424,"num_write_kb":8837004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":16,"num_bytes_hit_set_archive":3604,"num_flush":799,"num_flush_kb":22094,"num_evict":1905,"num_evict_kb":137723,"num_promote":2101,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1094,"num_omap_keys":119,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26167,"ondisk_log_size":26167,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1381204,"kb_used_data":452668,"kb_used_omap":0,"kb_used_meta":928512,"kb_avail":281734316,"statfs":{"total":289910292480,"available":288495939584,"internally_reserved":0,"allocated":463532032,"data_stored":461234860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":950796288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":925,"num_omap_keys":101,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001630"},"pg_stats":[{"pgid":"2.7","version":"156'1043","reported_seq":2035,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:35:10.949212+0000","last_change":"2023-12-06T18:35:10.949212+0000","last_active":"2023-12-06T18:35:10.949212+0000","last_peered":"2023-12-06T18:35:10.949212+0000","last_clean":"2023-12-06T18:35:10.949212+0000","last_became_active":"2023-12-06T15:25:48.206888+0000","last_became_peered":"2023-12-06T15:25:48.206888+0000","last_unstale":"2023-12-06T18:35:10.949212+0000","last_undegraded":"2023-12-06T18:35:10.949212+0000","last_fullsized":"2023-12-06T18:35:10.949212+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'1043","last_scrub_stamp":"2023-12-06T18:35:10.949126+0000","last_deep_scrub":"156'1043","last_deep_scrub_stamp":"2023-12-06T18:35:10.949126+0000","last_clean_scrub_stamp":"2023-12-06T18:35:10.949126+0000","log_size":1043,"ondisk_log_size":1043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":106983625,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":814,"num_read_kb":2793,"num_write":872,"num_write_kb":1182412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"156'868","reported_seq":1746,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:35:25.801712+0000","last_change":"2023-12-06T18:35:25.801712+0000","last_active":"2023-12-06T18:35:25.801712+0000","last_peered":"2023-12-06T18:35:25.801712+0000","last_clean":"2023-12-06T18:35:25.801712+0000","last_became_active":"2023-12-06T15:25:48.206986+0000","last_became_peered":"2023-12-06T15:25:48.206986+0000","last_unstale":"2023-12-06T18:35:25.801712+0000","last_undegraded":"2023-12-06T18:35:25.801712+0000","last_fullsized":"2023-12-06T18:35:25.801712+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'868","last_scrub_stamp":"2023-12-06T18:35:25.801630+0000","last_deep_scrub":"156'868","last_deep_scrub_stamp":"2023-12-06T18:35:25.801630+0000","last_clean_scrub_stamp":"2023-12-06T18:35:25.801630+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":47205134,"num_objects":21,"num_object_clones":1,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":1,"num_read":583,"num_read_kb":897,"num_write":705,"num_write_kb":1089454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":148,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"156'807","reported_seq":1769,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:35:23.741192+0000","last_change":"2023-12-06T18:35:23.741192+0000","last_active":"2023-12-06T18:35:23.741192+0000","last_peered":"2023-12-06T18:35:23.741192+0000","last_clean":"2023-12-06T18:35:23.741192+0000","last_became_active":"2023-12-06T15:25:48.206906+0000","last_became_peered":"2023-12-06T15:25:48.206906+0000","last_unstale":"2023-12-06T18:35:23.741192+0000","last_undegraded":"2023-12-06T18:35:23.741192+0000","last_fullsized":"2023-12-06T18:35:23.741192+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'807","last_scrub_stamp":"2023-12-06T18:35:23.741106+0000","last_deep_scrub":"156'807","last_deep_scrub_stamp":"2023-12-06T18:35:23.741106+0000","last_clean_scrub_stamp":"2023-12-06T18:35:23.741106+0000","log_size":807,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":40385513,"num_objects":26,"num_object_clones":1,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":771,"num_read_kb":4540,"num_write":652,"num_write_kb":964008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":223,"num_omap_keys":25,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"156'3404","reported_seq":8302,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:35:15.985142+0000","last_change":"2023-12-06T18:35:15.985142+0000","last_active":"2023-12-06T18:35:15.985142+0000","last_peered":"2023-12-06T18:35:15.985142+0000","last_clean":"2023-12-06T18:35:15.985142+0000","last_became_active":"2023-12-06T15:25:54.220756+0000","last_became_peered":"2023-12-06T15:25:54.220756+0000","last_unstale":"2023-12-06T18:35:15.985142+0000","last_undegraded":"2023-12-06T18:35:15.985142+0000","last_fullsized":"2023-12-06T18:35:15.985142+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'3404","last_scrub_stamp":"2023-12-06T18:35:15.985057+0000","last_deep_scrub":"156'3404","last_deep_scrub_stamp":"2023-12-06T18:35:15.985057+0000","last_clean_scrub_stamp":"2023-12-06T18:35:15.985057+0000","log_size":3404,"ondisk_log_size":3404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51299121,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":38,"num_read":12130,"num_read_kb":27934,"num_write":2245,"num_write_kb":1738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":719,"num_flush":173,"num_flush_kb":6205,"num_evict":482,"num_evict_kb":39117,"num_promote":533,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"156'1396","reported_seq":2355,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:32:50.626766+0000","last_change":"2023-12-06T18:32:50.626766+0000","last_active":"2023-12-06T18:32:50.626766+0000","last_peered":"2023-12-06T18:32:50.626766+0000","last_clean":"2023-12-06T18:32:50.626766+0000","last_became_active":"2023-12-06T15:25:48.204290+0000","last_became_peered":"2023-12-06T15:25:48.204290+0000","last_unstale":"2023-12-06T18:32:50.626766+0000","last_undegraded":"2023-12-06T18:32:50.626766+0000","last_fullsized":"2023-12-06T18:32:50.626766+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'1396","last_scrub_stamp":"2023-12-06T18:32:50.626638+0000","last_deep_scrub":"156'1396","last_deep_scrub_stamp":"2023-12-06T18:32:50.626638+0000","last_clean_scrub_stamp":"2023-12-06T18:32:50.626638+0000","log_size":1396,"ondisk_log_size":1396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":73011320,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":688,"num_read_kb":4922,"num_write":819,"num_write_kb":1094364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"153'3641","reported_seq":9475,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-12-06T16:28:53.728910+0000","last_change":"2023-12-06T15:30:17.620567+0000","last_active":"2023-12-06T16:28:53.728910+0000","last_peered":"2023-12-06T16:28:53.728910+0000","last_clean":"2023-12-06T16:28:53.728910+0000","last_became_active":"2023-12-06T15:25:54.223136+0000","last_became_peered":"2023-12-06T15:25:54.223136+0000","last_unstale":"2023-12-06T16:28:53.728910+0000","last_undegraded":"2023-12-06T16:28:53.728910+0000","last_fullsized":"2023-12-06T16:28:53.728910+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T15:25:53.208114+0000","last_clean_scrub_stamp":"2023-12-06T15:25:53.208114+0000","log_size":3641,"ondisk_log_size":3641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11076424,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":42,"num_read":10502,"num_read_kb":28911,"num_write":1839,"num_write_kb":767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":805,"num_flush":189,"num_flush_kb":1977,"num_evict":486,"num_evict_kb":35620,"num_promote":533,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":155,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:35:16.835383+0000","last_change":"2023-12-06T18:35:16.835383+0000","last_active":"2023-12-06T18:35:16.835383+0000","last_peered":"2023-12-06T18:35:16.835383+0000","last_clean":"2023-12-06T18:35:16.835383+0000","last_became_active":"2023-12-06T15:25:48.206870+0000","last_became_peered":"2023-12-06T15:25:48.206870+0000","last_unstale":"2023-12-06T18:35:16.835383+0000","last_undegraded":"2023-12-06T18:35:16.835383+0000","last_fullsized":"2023-12-06T18:35:16.835383+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T18:35:16.835287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T18:35:16.835287+0000","last_clean_scrub_stamp":"2023-12-06T18:35:16.835287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"156'1425","reported_seq":2302,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:35:17.891428+0000","last_change":"2023-12-06T18:35:17.891428+0000","last_active":"2023-12-06T18:35:17.891428+0000","last_peered":"2023-12-06T18:35:17.891428+0000","last_clean":"2023-12-06T18:35:17.891428+0000","last_became_active":"2023-12-06T15:25:48.205750+0000","last_became_peered":"2023-12-06T15:25:48.205750+0000","last_unstale":"2023-12-06T18:35:17.891428+0000","last_undegraded":"2023-12-06T18:35:17.891428+0000","last_fullsized":"2023-12-06T18:35:17.891428+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'1425","last_scrub_stamp":"2023-12-06T18:35:17.891344+0000","last_deep_scrub":"156'1425","last_deep_scrub_stamp":"2023-12-06T18:35:17.891344+0000","last_clean_scrub_stamp":"2023-12-06T18:35:17.891344+0000","log_size":1425,"ondisk_log_size":1425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":91811925,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":601,"num_read_kb":4028,"num_write":820,"num_write_kb":1199092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":175,"num_omap_keys":19,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"156'6510","reported_seq":14844,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:35:31.934308+0000","last_change":"2023-12-06T18:35:31.934308+0000","last_active":"2023-12-06T18:35:31.934308+0000","last_peered":"2023-12-06T18:35:31.934308+0000","last_clean":"2023-12-06T18:35:31.934308+0000","last_became_active":"2023-12-06T15:25:54.221489+0000","last_became_peered":"2023-12-06T15:25:54.221489+0000","last_unstale":"2023-12-06T18:35:31.934308+0000","last_undegraded":"2023-12-06T18:35:31.934308+0000","last_fullsized":"2023-12-06T18:35:31.934308+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'6510","last_scrub_stamp":"2023-12-06T18:35:31.934187+0000","last_deep_scrub":"156'6510","last_deep_scrub_stamp":"2023-12-06T18:35:31.934187+0000","last_clean_scrub_stamp":"2023-12-06T18:35:31.934187+0000","log_size":6510,"ondisk_log_size":6510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":42890638,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":35,"num_read":24199,"num_read_kb":36879,"num_write":5231,"num_write_kb":3994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1414,"num_flush":231,"num_flush_kb":8685,"num_evict":509,"num_evict_kb":32296,"num_promote":556,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"156'926","reported_seq":1809,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:32:57.697314+0000","last_change":"2023-12-06T18:32:57.697314+0000","last_active":"2023-12-06T18:32:57.697314+0000","last_peered":"2023-12-06T18:32:57.697314+0000","last_clean":"2023-12-06T18:32:57.697314+0000","last_became_active":"2023-12-06T15:25:48.205967+0000","last_became_peered":"2023-12-06T15:25:48.205967+0000","last_unstale":"2023-12-06T18:32:57.697314+0000","last_undegraded":"2023-12-06T18:32:57.697314+0000","last_fullsized":"2023-12-06T18:32:57.697314+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'926","last_scrub_stamp":"2023-12-06T18:32:57.697195+0000","last_deep_scrub":"156'926","last_deep_scrub_stamp":"2023-12-06T18:32:57.697195+0000","last_clean_scrub_stamp":"2023-12-06T18:32:57.697195+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":113639590,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":664,"num_read_kb":403,"num_write":770,"num_write_kb":1081998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"156'4145","reported_seq":11145,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:35:18.985396+0000","last_change":"2023-12-06T18:35:18.985396+0000","last_active":"2023-12-06T18:35:18.985396+0000","last_peered":"2023-12-06T18:35:18.985396+0000","last_clean":"2023-12-06T18:35:18.985396+0000","last_became_active":"2023-12-06T15:25:54.221304+0000","last_became_peered":"2023-12-06T15:25:54.221304+0000","last_unstale":"2023-12-06T18:35:18.985396+0000","last_undegraded":"2023-12-06T18:35:18.985396+0000","last_fullsized":"2023-12-06T18:35:18.985396+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'4145","last_scrub_stamp":"2023-12-06T18:35:18.985270+0000","last_deep_scrub":"156'4145","last_deep_scrub_stamp":"2023-12-06T18:35:18.985270+0000","last_clean_scrub_stamp":"2023-12-06T18:35:18.985270+0000","log_size":4145,"ondisk_log_size":4145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":41243290,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":40,"num_read":13526,"num_read_kb":30612,"num_write":2847,"num_write_kb":2055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":666,"num_flush":206,"num_flush_kb":5227,"num_evict":428,"num_evict_kb":30690,"num_promote":479,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"156'1109","reported_seq":1981,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:35:13.953096+0000","last_change":"2023-12-06T18:35:13.953096+0000","last_active":"2023-12-06T18:35:13.953096+0000","last_peered":"2023-12-06T18:35:13.953096+0000","last_clean":"2023-12-06T18:35:13.953096+0000","last_became_active":"2023-12-06T15:25:48.204147+0000","last_became_peered":"2023-12-06T15:25:48.204147+0000","last_unstale":"2023-12-06T18:35:13.953096+0000","last_undegraded":"2023-12-06T18:35:13.953096+0000","last_fullsized":"2023-12-06T18:35:13.953096+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'1109","last_scrub_stamp":"2023-12-06T18:35:13.952998+0000","last_deep_scrub":"156'1109","last_deep_scrub_stamp":"2023-12-06T18:35:13.952998+0000","last_clean_scrub_stamp":"2023-12-06T18:35:13.952998+0000","log_size":1109,"ondisk_log_size":1109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127537306,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":556,"num_read_kb":811,"num_write":921,"num_write_kb":1173359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"156'893","reported_seq":1803,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:35:22.754913+0000","last_change":"2023-12-06T18:35:22.754913+0000","last_active":"2023-12-06T18:35:22.754913+0000","last_peered":"2023-12-06T18:35:22.754913+0000","last_clean":"2023-12-06T18:35:22.754913+0000","last_became_active":"2023-12-06T15:25:48.204913+0000","last_became_peered":"2023-12-06T15:25:48.204913+0000","last_unstale":"2023-12-06T18:35:22.754913+0000","last_undegraded":"2023-12-06T18:35:22.754913+0000","last_fullsized":"2023-12-06T18:35:22.754913+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'893","last_scrub_stamp":"2023-12-06T18:35:22.754830+0000","last_deep_scrub":"156'893","last_deep_scrub_stamp":"2023-12-06T18:35:22.754830+0000","last_clean_scrub_stamp":"2023-12-06T18:35:22.754830+0000","log_size":893,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":43483484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":604,"num_read_kb":608,"num_write":703,"num_write_kb":1043763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":305,"num_omap_keys":30,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":146509473,"num_objects":216,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":155,"num_read":60357,"num_read_kb":124336,"num_write":12162,"num_write_kb":8554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":16,"num_bytes_hit_set_archive":3604,"num_flush":799,"num_flush_kb":22094,"num_evict":1905,"num_evict_kb":137723,"num_promote":2101,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":187801600,"data_stored":187645250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17700,"ondisk_log_size":17700,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":644057897,"num_objects":264,"num_object_clones":2,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264,"num_whiteouts":2,"num_read":5281,"num_read_kb":19002,"num_write":6262,"num_write_kb":8828450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1020,"num_omap_keys":108,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":271777792,"data_stored":271513170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8467,"ondisk_log_size":8467,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740651,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":444440,"kb_used_data":134928,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93927400,"statfs":{"total":96636764160,"available":96181657600,"internally_reserved":0,"allocated":138166272,"data_stored":137425212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 18:35:09 2023","interfaces":[{"interface":"back","average":{"1min":0.23499999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"min":{"1min":0.17000000000000001,"5min":0.13800000000000001,"15min":0.13800000000000001},"max":{"1min":0.36899999999999999,"5min":0.42499999999999999,"15min":0.441},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.21099999999999999,"5min":0.22900000000000001,"15min":0.23599999999999999},"min":{"1min":0.16800000000000001,"5min":0.155,"15min":0.155},"max":{"1min":0.317,"5min":0.45600000000000002,"15min":0.46100000000000002},"last":0.224}]},{"osd":1,"last update":"Wed Dec 6 18:35:09 2023","interfaces":[{"interface":"back","average":{"1min":0.23499999999999999,"5min":0.24299999999999999,"15min":0.248},"min":{"1min":0.17699999999999999,"5min":0.16,"15min":0.16},"max":{"1min":0.33500000000000002,"5min":0.45400000000000001,"15min":0.48799999999999999},"last":0.19500000000000001},{"interface":"front","average":{"1min":0.255,"5min":0.26500000000000001,"15min":0.27400000000000002},"min":{"1min":0.20100000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.39800000000000002,"5min":0.47299999999999998,"15min":0.48899999999999999},"last":0.26800000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740650,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":468184,"kb_used_data":158672,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93903656,"statfs":{"total":96636764160,"available":96157343744,"internally_reserved":0,"allocated":162480128,"data_stored":161733705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 18:35:09 2023","interfaces":[{"interface":"back","average":{"1min":0.188,"5min":0.19500000000000001,"15min":0.20799999999999999},"min":{"1min":0.14199999999999999,"5min":0.13600000000000001,"15min":0.13200000000000001},"max":{"1min":0.34200000000000003,"5min":0.36799999999999999,"15min":0.45000000000000001},"last":0.14099999999999999},{"interface":"front","average":{"1min":0.247,"5min":0.252,"15min":0.254},"min":{"1min":0.20300000000000001,"5min":0.17100000000000001,"15min":0.159},"max":{"1min":0.41599999999999998,"5min":0.44700000000000001,"15min":0.46100000000000002},"last":0.20200000000000001}]},{"osd":2,"last update":"Wed Dec 6 18:35:09 2023","interfaces":[{"interface":"back","average":{"1min":0.22,"5min":0.22,"15min":0.223},"min":{"1min":0.17199999999999999,"5min":0.16400000000000001,"15min":0.161},"max":{"1min":0.38,"5min":0.40999999999999998,"15min":0.43099999999999999},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.22700000000000001,"5min":0.23200000000000001,"15min":0.23499999999999999},"min":{"1min":0.183,"5min":0.17100000000000001,"15min":0.16700000000000001},"max":{"1min":0.374,"5min":0.41599999999999998,"15min":0.48399999999999999},"last":0.18099999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740651,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":468580,"kb_used_data":159068,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93903260,"statfs":{"total":96636764160,"available":96156938240,"internally_reserved":0,"allocated":162885632,"data_stored":162075943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 18:35:20 2023","interfaces":[{"interface":"back","average":{"1min":0.21299999999999999,"5min":0.20100000000000001,"15min":0.20699999999999999},"min":{"1min":0.154,"5min":0.13400000000000001,"15min":0.13400000000000001},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.14499999999999999},{"interface":"front","average":{"1min":0.27000000000000002,"5min":0.26100000000000001,"15min":0.26400000000000001},"min":{"1min":0.20999999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.19600000000000001}]},{"osd":2,"last update":"Wed Dec 6 18:35:20 2023","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.23599999999999999,"15min":0.23499999999999999},"min":{"1min":0.189,"5min":0.185,"15min":0.16700000000000001},"max":{"1min":0.29399999999999998,"5min":0.443,"15min":0.443},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.246,"5min":0.249,"15min":0.245},"min":{"1min":0.223,"5min":0.17299999999999999,"15min":0.17000000000000001},"max":{"1min":0.30099999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.20599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":92942336,"data_stored":92846518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":135888896,"data_stored":135756585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":42946560,"data_stored":42910067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68222976,"data_stored":68195787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25677824,"data_stored":25626838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":93900800,"data_stored":93822625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T18:35:34.488 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T15:25:53.208114+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=15, tm_min=25, tm_sec=53, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=18, tm_min=28, tm_sec=46, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T18:35:34.488 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T18:35:34.779 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:34.776+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:34.790 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:34.787+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:35.755 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:35.752+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:35.797 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:35.794+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:36.735 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:36.731+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:36.752 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:36.749+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:37.735 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:37.732+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:37.767 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:37.764+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:38.771 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:38.768+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:38.804 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:38.801+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:39.772 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:39.769+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:39.793 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:39.790+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:40.748 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:40.745+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:40.807 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:40.804+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:41.703 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:41.700+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:41.819 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:41.816+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:42.725 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:42.721+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:42.840 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:42.836+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:43.774 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:43.771+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:43.857 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:43.853+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:44.791 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:44.788+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:44.890 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:44.887+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:45.746 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:45.743+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:45.846 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:45.842+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:46.725 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:46.722+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:46.801 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:46.798+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:47.724 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:47.721+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:47.753 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:47.750+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:48.759 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:48.756+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:48.792 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:48.789+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:49.769 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:49.766+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:49.794 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:49.791+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:50.768 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:50.764+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:50.818 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:50.815+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:51.782 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:51.779+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:51.847 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:51.844+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:52.813 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:52.810+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:52.847 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:52.844+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:53.827 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:53.824+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:53.844 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:53.841+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:54.489 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T18:35:54.802 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-06T18:35:54.804 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2023-12-06T18:35:54.814 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-12-06T18:35:54.811+0000 7f29d5b73700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:330 3.0 3:3cb7c67d:test1::rbd_data.294c5a02e274.00000000000000aa:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3993600~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e153) 2023-12-06T18:35:54.817 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":5856,"stamp":"2023-12-06T18:35:52.825597+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":790567370,"num_objects":480,"num_object_clones":2,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":385,"num_whiteouts":157,"num_read":65638,"num_read_kb":143338,"num_write":18424,"num_write_kb":8837004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":16,"num_bytes_hit_set_archive":3604,"num_flush":799,"num_flush_kb":22094,"num_evict":1905,"num_evict_kb":137723,"num_promote":2101,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1094,"num_omap_keys":119,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26219,"ondisk_log_size":26219,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1385300,"kb_used_data":452668,"kb_used_omap":0,"kb_used_meta":932608,"kb_avail":281730220,"statfs":{"total":289910292480,"available":288491745280,"internally_reserved":0,"allocated":463532032,"data_stored":461234860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":954990592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001747"},"pg_stats":[{"pgid":"2.7","version":"156'1043","reported_seq":2035,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:35:10.949212+0000","last_change":"2023-12-06T18:35:10.949212+0000","last_active":"2023-12-06T18:35:10.949212+0000","last_peered":"2023-12-06T18:35:10.949212+0000","last_clean":"2023-12-06T18:35:10.949212+0000","last_became_active":"2023-12-06T15:25:48.206888+0000","last_became_peered":"2023-12-06T15:25:48.206888+0000","last_unstale":"2023-12-06T18:35:10.949212+0000","last_undegraded":"2023-12-06T18:35:10.949212+0000","last_fullsized":"2023-12-06T18:35:10.949212+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'1043","last_scrub_stamp":"2023-12-06T18:35:10.949126+0000","last_deep_scrub":"156'1043","last_deep_scrub_stamp":"2023-12-06T18:35:10.949126+0000","last_clean_scrub_stamp":"2023-12-06T18:35:10.949126+0000","log_size":1043,"ondisk_log_size":1043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":106983625,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":814,"num_read_kb":2793,"num_write":872,"num_write_kb":1182412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"156'868","reported_seq":1746,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:35:25.801712+0000","last_change":"2023-12-06T18:35:25.801712+0000","last_active":"2023-12-06T18:35:25.801712+0000","last_peered":"2023-12-06T18:35:25.801712+0000","last_clean":"2023-12-06T18:35:25.801712+0000","last_became_active":"2023-12-06T15:25:48.206986+0000","last_became_peered":"2023-12-06T15:25:48.206986+0000","last_unstale":"2023-12-06T18:35:25.801712+0000","last_undegraded":"2023-12-06T18:35:25.801712+0000","last_fullsized":"2023-12-06T18:35:25.801712+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'868","last_scrub_stamp":"2023-12-06T18:35:25.801630+0000","last_deep_scrub":"156'868","last_deep_scrub_stamp":"2023-12-06T18:35:25.801630+0000","last_clean_scrub_stamp":"2023-12-06T18:35:25.801630+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":47205134,"num_objects":21,"num_object_clones":1,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":1,"num_read":583,"num_read_kb":897,"num_write":705,"num_write_kb":1089454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":148,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"156'807","reported_seq":1769,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:35:23.741192+0000","last_change":"2023-12-06T18:35:23.741192+0000","last_active":"2023-12-06T18:35:23.741192+0000","last_peered":"2023-12-06T18:35:23.741192+0000","last_clean":"2023-12-06T18:35:23.741192+0000","last_became_active":"2023-12-06T15:25:48.206906+0000","last_became_peered":"2023-12-06T15:25:48.206906+0000","last_unstale":"2023-12-06T18:35:23.741192+0000","last_undegraded":"2023-12-06T18:35:23.741192+0000","last_fullsized":"2023-12-06T18:35:23.741192+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'807","last_scrub_stamp":"2023-12-06T18:35:23.741106+0000","last_deep_scrub":"156'807","last_deep_scrub_stamp":"2023-12-06T18:35:23.741106+0000","last_clean_scrub_stamp":"2023-12-06T18:35:23.741106+0000","log_size":807,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":40385513,"num_objects":26,"num_object_clones":1,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":771,"num_read_kb":4540,"num_write":652,"num_write_kb":964008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":223,"num_omap_keys":25,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"156'3404","reported_seq":8302,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:35:15.985142+0000","last_change":"2023-12-06T18:35:15.985142+0000","last_active":"2023-12-06T18:35:15.985142+0000","last_peered":"2023-12-06T18:35:15.985142+0000","last_clean":"2023-12-06T18:35:15.985142+0000","last_became_active":"2023-12-06T15:25:54.220756+0000","last_became_peered":"2023-12-06T15:25:54.220756+0000","last_unstale":"2023-12-06T18:35:15.985142+0000","last_undegraded":"2023-12-06T18:35:15.985142+0000","last_fullsized":"2023-12-06T18:35:15.985142+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'3404","last_scrub_stamp":"2023-12-06T18:35:15.985057+0000","last_deep_scrub":"156'3404","last_deep_scrub_stamp":"2023-12-06T18:35:15.985057+0000","last_clean_scrub_stamp":"2023-12-06T18:35:15.985057+0000","log_size":3404,"ondisk_log_size":3404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51299121,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":38,"num_read":12130,"num_read_kb":27934,"num_write":2245,"num_write_kb":1738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":719,"num_flush":173,"num_flush_kb":6205,"num_evict":482,"num_evict_kb":39117,"num_promote":533,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"156'1396","reported_seq":2355,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:32:50.626766+0000","last_change":"2023-12-06T18:32:50.626766+0000","last_active":"2023-12-06T18:32:50.626766+0000","last_peered":"2023-12-06T18:32:50.626766+0000","last_clean":"2023-12-06T18:32:50.626766+0000","last_became_active":"2023-12-06T15:25:48.204290+0000","last_became_peered":"2023-12-06T15:25:48.204290+0000","last_unstale":"2023-12-06T18:32:50.626766+0000","last_undegraded":"2023-12-06T18:32:50.626766+0000","last_fullsized":"2023-12-06T18:32:50.626766+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'1396","last_scrub_stamp":"2023-12-06T18:32:50.626638+0000","last_deep_scrub":"156'1396","last_deep_scrub_stamp":"2023-12-06T18:32:50.626638+0000","last_clean_scrub_stamp":"2023-12-06T18:32:50.626638+0000","log_size":1396,"ondisk_log_size":1396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":73011320,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":688,"num_read_kb":4922,"num_write":819,"num_write_kb":1094364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"156'3693","reported_seq":9532,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:35:33.845048+0000","last_change":"2023-12-06T18:35:33.845048+0000","last_active":"2023-12-06T18:35:33.845048+0000","last_peered":"2023-12-06T18:35:33.845048+0000","last_clean":"2023-12-06T18:35:33.845048+0000","last_became_active":"2023-12-06T15:25:54.223136+0000","last_became_peered":"2023-12-06T15:25:54.223136+0000","last_unstale":"2023-12-06T18:35:33.845048+0000","last_undegraded":"2023-12-06T18:35:33.845048+0000","last_fullsized":"2023-12-06T18:35:33.845048+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'3693","last_scrub_stamp":"2023-12-06T18:35:33.844961+0000","last_deep_scrub":"156'3693","last_deep_scrub_stamp":"2023-12-06T18:35:33.844961+0000","last_clean_scrub_stamp":"2023-12-06T18:35:33.844961+0000","log_size":3693,"ondisk_log_size":3693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11076424,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":42,"num_read":10502,"num_read_kb":28911,"num_write":1839,"num_write_kb":767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":805,"num_flush":189,"num_flush_kb":1977,"num_evict":486,"num_evict_kb":35620,"num_promote":533,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":155,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:35:16.835383+0000","last_change":"2023-12-06T18:35:16.835383+0000","last_active":"2023-12-06T18:35:16.835383+0000","last_peered":"2023-12-06T18:35:16.835383+0000","last_clean":"2023-12-06T18:35:16.835383+0000","last_became_active":"2023-12-06T15:25:48.206870+0000","last_became_peered":"2023-12-06T15:25:48.206870+0000","last_unstale":"2023-12-06T18:35:16.835383+0000","last_undegraded":"2023-12-06T18:35:16.835383+0000","last_fullsized":"2023-12-06T18:35:16.835383+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T18:35:16.835287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T18:35:16.835287+0000","last_clean_scrub_stamp":"2023-12-06T18:35:16.835287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"156'1425","reported_seq":2302,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:35:17.891428+0000","last_change":"2023-12-06T18:35:17.891428+0000","last_active":"2023-12-06T18:35:17.891428+0000","last_peered":"2023-12-06T18:35:17.891428+0000","last_clean":"2023-12-06T18:35:17.891428+0000","last_became_active":"2023-12-06T15:25:48.205750+0000","last_became_peered":"2023-12-06T15:25:48.205750+0000","last_unstale":"2023-12-06T18:35:17.891428+0000","last_undegraded":"2023-12-06T18:35:17.891428+0000","last_fullsized":"2023-12-06T18:35:17.891428+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'1425","last_scrub_stamp":"2023-12-06T18:35:17.891344+0000","last_deep_scrub":"156'1425","last_deep_scrub_stamp":"2023-12-06T18:35:17.891344+0000","last_clean_scrub_stamp":"2023-12-06T18:35:17.891344+0000","log_size":1425,"ondisk_log_size":1425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":91811925,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":601,"num_read_kb":4028,"num_write":820,"num_write_kb":1199092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":175,"num_omap_keys":19,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"156'6510","reported_seq":14844,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:35:31.934308+0000","last_change":"2023-12-06T18:35:31.934308+0000","last_active":"2023-12-06T18:35:31.934308+0000","last_peered":"2023-12-06T18:35:31.934308+0000","last_clean":"2023-12-06T18:35:31.934308+0000","last_became_active":"2023-12-06T15:25:54.221489+0000","last_became_peered":"2023-12-06T15:25:54.221489+0000","last_unstale":"2023-12-06T18:35:31.934308+0000","last_undegraded":"2023-12-06T18:35:31.934308+0000","last_fullsized":"2023-12-06T18:35:31.934308+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'6510","last_scrub_stamp":"2023-12-06T18:35:31.934187+0000","last_deep_scrub":"156'6510","last_deep_scrub_stamp":"2023-12-06T18:35:31.934187+0000","last_clean_scrub_stamp":"2023-12-06T18:35:31.934187+0000","log_size":6510,"ondisk_log_size":6510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":42890638,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":35,"num_read":24199,"num_read_kb":36879,"num_write":5231,"num_write_kb":3994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1414,"num_flush":231,"num_flush_kb":8685,"num_evict":509,"num_evict_kb":32296,"num_promote":556,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"156'926","reported_seq":1809,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:32:57.697314+0000","last_change":"2023-12-06T18:32:57.697314+0000","last_active":"2023-12-06T18:32:57.697314+0000","last_peered":"2023-12-06T18:32:57.697314+0000","last_clean":"2023-12-06T18:32:57.697314+0000","last_became_active":"2023-12-06T15:25:48.205967+0000","last_became_peered":"2023-12-06T15:25:48.205967+0000","last_unstale":"2023-12-06T18:32:57.697314+0000","last_undegraded":"2023-12-06T18:32:57.697314+0000","last_fullsized":"2023-12-06T18:32:57.697314+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'926","last_scrub_stamp":"2023-12-06T18:32:57.697195+0000","last_deep_scrub":"156'926","last_deep_scrub_stamp":"2023-12-06T18:32:57.697195+0000","last_clean_scrub_stamp":"2023-12-06T18:32:57.697195+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":113639590,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":664,"num_read_kb":403,"num_write":770,"num_write_kb":1081998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"156'4145","reported_seq":11145,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:35:18.985396+0000","last_change":"2023-12-06T18:35:18.985396+0000","last_active":"2023-12-06T18:35:18.985396+0000","last_peered":"2023-12-06T18:35:18.985396+0000","last_clean":"2023-12-06T18:35:18.985396+0000","last_became_active":"2023-12-06T15:25:54.221304+0000","last_became_peered":"2023-12-06T15:25:54.221304+0000","last_unstale":"2023-12-06T18:35:18.985396+0000","last_undegraded":"2023-12-06T18:35:18.985396+0000","last_fullsized":"2023-12-06T18:35:18.985396+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'4145","last_scrub_stamp":"2023-12-06T18:35:18.985270+0000","last_deep_scrub":"156'4145","last_deep_scrub_stamp":"2023-12-06T18:35:18.985270+0000","last_clean_scrub_stamp":"2023-12-06T18:35:18.985270+0000","log_size":4145,"ondisk_log_size":4145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":41243290,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":40,"num_read":13526,"num_read_kb":30612,"num_write":2847,"num_write_kb":2055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":666,"num_flush":206,"num_flush_kb":5227,"num_evict":428,"num_evict_kb":30690,"num_promote":479,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"156'1109","reported_seq":1981,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:35:13.953096+0000","last_change":"2023-12-06T18:35:13.953096+0000","last_active":"2023-12-06T18:35:13.953096+0000","last_peered":"2023-12-06T18:35:13.953096+0000","last_clean":"2023-12-06T18:35:13.953096+0000","last_became_active":"2023-12-06T15:25:48.204147+0000","last_became_peered":"2023-12-06T15:25:48.204147+0000","last_unstale":"2023-12-06T18:35:13.953096+0000","last_undegraded":"2023-12-06T18:35:13.953096+0000","last_fullsized":"2023-12-06T18:35:13.953096+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'1109","last_scrub_stamp":"2023-12-06T18:35:13.952998+0000","last_deep_scrub":"156'1109","last_deep_scrub_stamp":"2023-12-06T18:35:13.952998+0000","last_clean_scrub_stamp":"2023-12-06T18:35:13.952998+0000","log_size":1109,"ondisk_log_size":1109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127537306,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":556,"num_read_kb":811,"num_write":921,"num_write_kb":1173359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"156'893","reported_seq":1803,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-12-06T18:35:22.754913+0000","last_change":"2023-12-06T18:35:22.754913+0000","last_active":"2023-12-06T18:35:22.754913+0000","last_peered":"2023-12-06T18:35:22.754913+0000","last_clean":"2023-12-06T18:35:22.754913+0000","last_became_active":"2023-12-06T15:25:48.204913+0000","last_became_peered":"2023-12-06T15:25:48.204913+0000","last_unstale":"2023-12-06T18:35:22.754913+0000","last_undegraded":"2023-12-06T18:35:22.754913+0000","last_fullsized":"2023-12-06T18:35:22.754913+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'893","last_scrub_stamp":"2023-12-06T18:35:22.754830+0000","last_deep_scrub":"156'893","last_deep_scrub_stamp":"2023-12-06T18:35:22.754830+0000","last_clean_scrub_stamp":"2023-12-06T18:35:22.754830+0000","log_size":893,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":43483484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":604,"num_read_kb":608,"num_write":703,"num_write_kb":1043763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":305,"num_omap_keys":30,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":146509473,"num_objects":216,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":155,"num_read":60357,"num_read_kb":124336,"num_write":12162,"num_write_kb":8554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":16,"num_bytes_hit_set_archive":3604,"num_flush":799,"num_flush_kb":22094,"num_evict":1905,"num_evict_kb":137723,"num_promote":2101,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":187801600,"data_stored":187645250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17752,"ondisk_log_size":17752,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":644057897,"num_objects":264,"num_object_clones":2,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264,"num_whiteouts":2,"num_read":5281,"num_read_kb":19002,"num_write":6262,"num_write_kb":8828450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1020,"num_omap_keys":108,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":271777792,"data_stored":271513170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8467,"ondisk_log_size":8467,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740655,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":444440,"kb_used_data":134928,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93927400,"statfs":{"total":96636764160,"available":96181657600,"internally_reserved":0,"allocated":138166272,"data_stored":137425212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 18:35:09 2023","interfaces":[{"interface":"back","average":{"1min":0.23499999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"min":{"1min":0.17000000000000001,"5min":0.13800000000000001,"15min":0.13800000000000001},"max":{"1min":0.36899999999999999,"5min":0.42499999999999999,"15min":0.441},"last":0.253},{"interface":"front","average":{"1min":0.21099999999999999,"5min":0.22900000000000001,"15min":0.23599999999999999},"min":{"1min":0.16800000000000001,"5min":0.155,"15min":0.155},"max":{"1min":0.317,"5min":0.45600000000000002,"15min":0.46100000000000002},"last":0.221}]},{"osd":1,"last update":"Wed Dec 6 18:35:09 2023","interfaces":[{"interface":"back","average":{"1min":0.23499999999999999,"5min":0.24299999999999999,"15min":0.248},"min":{"1min":0.17699999999999999,"5min":0.16,"15min":0.16},"max":{"1min":0.33500000000000002,"5min":0.45400000000000001,"15min":0.48799999999999999},"last":0.312},{"interface":"front","average":{"1min":0.255,"5min":0.26500000000000001,"15min":0.27400000000000002},"min":{"1min":0.20100000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.39800000000000002,"5min":0.47299999999999998,"15min":0.48899999999999999},"last":0.28699999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740654,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":468184,"kb_used_data":158672,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93903656,"statfs":{"total":96636764160,"available":96157343744,"internally_reserved":0,"allocated":162480128,"data_stored":161733705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 18:35:09 2023","interfaces":[{"interface":"back","average":{"1min":0.188,"5min":0.19500000000000001,"15min":0.20799999999999999},"min":{"1min":0.14199999999999999,"5min":0.13600000000000001,"15min":0.13200000000000001},"max":{"1min":0.34200000000000003,"5min":0.36799999999999999,"15min":0.45000000000000001},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.247,"5min":0.252,"15min":0.254},"min":{"1min":0.20300000000000001,"5min":0.17100000000000001,"15min":0.159},"max":{"1min":0.41599999999999998,"5min":0.44700000000000001,"15min":0.46100000000000002},"last":0.20999999999999999}]},{"osd":2,"last update":"Wed Dec 6 18:35:09 2023","interfaces":[{"interface":"back","average":{"1min":0.22,"5min":0.22,"15min":0.223},"min":{"1min":0.17199999999999999,"5min":0.16400000000000001,"15min":0.161},"max":{"1min":0.38,"5min":0.40999999999999998,"15min":0.43099999999999999},"last":0.19900000000000001},{"interface":"front","average":{"1min":0.22700000000000001,"5min":0.23200000000000001,"15min":0.23499999999999999},"min":{"1min":0.183,"5min":0.17100000000000001,"15min":0.16700000000000001},"max":{"1min":0.374,"5min":0.41599999999999998,"15min":0.48399999999999999},"last":0.22600000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740655,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":472676,"kb_used_data":159068,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93899164,"statfs":{"total":96636764160,"available":96152743936,"internally_reserved":0,"allocated":162885632,"data_stored":162075943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 18:35:20 2023","interfaces":[{"interface":"back","average":{"1min":0.21299999999999999,"5min":0.20100000000000001,"15min":0.20699999999999999},"min":{"1min":0.154,"5min":0.13400000000000001,"15min":0.13400000000000001},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.16600000000000001},{"interface":"front","average":{"1min":0.27000000000000002,"5min":0.26100000000000001,"15min":0.26400000000000001},"min":{"1min":0.20999999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.248}]},{"osd":2,"last update":"Wed Dec 6 18:35:20 2023","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.23599999999999999,"15min":0.23499999999999999},"min":{"1min":0.189,"5min":0.185,"15min":0.16700000000000001},"max":{"1min":0.29399999999999998,"5min":0.443,"15min":0.443},"last":0.19700000000000001},{"interface":"front","average":{"1min":0.246,"5min":0.249,"15min":0.245},"min":{"1min":0.223,"5min":0.17299999999999999,"15min":0.17000000000000001},"max":{"1min":0.30099999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.22500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":92942336,"data_stored":92846518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":135888896,"data_stored":135756585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":42946560,"data_stored":42910067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68222976,"data_stored":68195787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25677824,"data_stored":25626838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":93900800,"data_stored":93822625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T18:35:54.819 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-06T18:35:54.877 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-12-06T18:35:54.874+0000 7efce025d700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10575.0:1219 3.1 3:b7281239:test1::rbd_data.294c5a02e274.0000000000000091:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1679360~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e153) 2023-12-06T18:35:55.181 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-06T18:35:55.181 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-06T18:35:55.182 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-06T18:35:55.182 INFO:teuthology.orchestra.run:waiting for 300 2023-12-06T18:35:55.223 INFO:tasks.ceph.osd.0:Stopped 2023-12-06T18:35:55.224 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-06T18:35:55.224 INFO:teuthology.orchestra.run:waiting for 300 2023-12-06T18:35:55.258 INFO:tasks.ceph.osd.1:Stopped 2023-12-06T18:35:55.258 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-06T18:35:55.259 INFO:teuthology.orchestra.run:waiting for 300 2023-12-06T18:35:55.333 INFO:tasks.ceph.osd.2:Stopped 2023-12-06T18:35:55.334 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-06T18:35:55.334 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-06T18:35:55.334 INFO:teuthology.orchestra.run:waiting for 300 2023-12-06T18:35:55.395 INFO:tasks.ceph.mgr.x:Stopped 2023-12-06T18:35:55.395 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-06T18:35:55.396 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-06T18:35:55.396 INFO:teuthology.orchestra.run:waiting for 300 2023-12-06T18:35:55.467 INFO:tasks.ceph.mon.a:Stopped 2023-12-06T18:35:55.467 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-06T18:35:55.467 DEBUG:teuthology.orchestra.run.smithi123:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | head -n 1 2023-12-06T18:35:55.535 INFO:teuthology.orchestra.run.smithi123.stdout:2023-12-06T15:31:04.365967+0000 osd.1 (osd.1) 3 : cluster [WRN] 14 slow requests (by type [ 'reached pg' : 14 ] most affected pool [ 'cache' : 14 ]) 2023-12-06T18:35:55.536 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-12-06T18:35:55.536 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi123.front.sepia.ceph.com 2023-12-06T18:35:55.537 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-06T18:35:55.943 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi123.front.sepia.ceph.com 2023-12-06T18:35:55.943 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-06T18:35:56.077 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi123.front.sepia.ceph.com 2023-12-06T18:35:56.077 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-06T18:35:56.151 INFO:tasks.ceph:Archiving mon data... 2023-12-06T18:35:56.153 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-12-06_15:04:09-rbd-wip-yuri6-testing-2023-12-05-0753-pacific-distro-default-smithi/7480284/data/mon.a.tgz 2023-12-06T18:35:56.153 DEBUG:teuthology.orchestra.run.smithi123:> mktemp 2023-12-06T18:35:56.171 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/tmp.3KyDaI66ie 2023-12-06T18:35:56.171 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.3KyDaI66ie 2023-12-06T18:35:56.447 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0666 /tmp/tmp.3KyDaI66ie 2023-12-06T18:35:56.535 DEBUG:teuthology.orchestra.remote:smithi123:/tmp/tmp.3KyDaI66ie is 578KB 2023-12-06T18:35:56.638 DEBUG:teuthology.orchestra.run.smithi123:> rm -fr /tmp/tmp.3KyDaI66ie 2023-12-06T18:35:56.656 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-06T18:35:56.656 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-06T18:35:56.722 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-12-06T18:35:56.722 DEBUG:teuthology.orchestra.run.smithi123:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-06T18:35:56.789 INFO:teuthology.orchestra.run.smithi123.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-06T18:35:56.794 INFO:tasks.ceph:Archiving crash dumps... 2023-12-06T18:35:56.796 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-06_15:04:09-rbd-wip-yuri6-testing-2023-12-05-0753-pacific-distro-default-smithi/7480284/remote/smithi123/crash 2023-12-06T18:35:56.796 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-06T18:35:56.861 INFO:tasks.ceph:Compressing logs... 2023-12-06T18:35:56.861 DEBUG:teuthology.orchestra.run.smithi123:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-06T18:35:57.372 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160591.log 2023-12-06T18:35:57.373 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143609.log 2023-12-06T18:35:57.373 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134545.log 2023-12-06T18:35:57.373 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160591.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160591.log.gz 2023-12-06T18:35:57.373 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.143609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152273.log 2023-12-06T18:35:57.373 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143609.log.gz 2023-12-06T18:35:57.373 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150651.log 2023-12-06T18:35:57.374 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134545.log: 53.5% -- replaced with /var/log/ceph/ceph-client.admin.134545.log.gz 2023-12-06T18:35:57.374 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140467.log 2023-12-06T18:35:57.374 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152273.log.gz 2023-12-06T18:35:57.374 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160219.log 2023-12-06T18:35:57.374 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150651.log.gz 2023-12-06T18:35:57.374 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119594.log 2023-12-06T18:35:57.374 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140467.log.gz 2023-12-06T18:35:57.374 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135373.log 2023-12-06T18:35:57.374 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160219.log.gz 2023-12-06T18:35:57.375 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122914.log 2023-12-06T18:35:57.375 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119594.log.gz 2023-12-06T18:35:57.375 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124077.log 2023-12-06T18:35:57.375 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135373.log.gz 2023-12-06T18:35:57.375 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126290.log 2023-12-06T18:35:57.375 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122914.log.gz 2023-12-06T18:35:57.375 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122506.log 2023-12-06T18:35:57.375 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124077.log.gz 2023-12-06T18:35:57.376 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126290.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126290.log.gz 2023-12-06T18:35:57.376 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120983.log 2023-12-06T18:35:57.376 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136383.log 2023-12-06T18:35:57.376 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122506.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122506.log.gz 2023-12-06T18:35:57.376 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134504.log 2023-12-06T18:35:57.376 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120983.log.gz 2023-12-06T18:35:57.376 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122463.log 2023-12-06T18:35:57.376 INFO:teuthology.orchestra.run.smithi123.stderr: 24.0% -- replaced with /var/log/ceph/ceph-client.admin.136383.log.gz 2023-12-06T18:35:57.376 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143050.log 2023-12-06T18:35:57.377 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134504.log.gz 2023-12-06T18:35:57.377 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122463.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122463.log.gz 2023-12-06T18:35:57.377 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131268.log 2023-12-06T18:35:57.377 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138055.log 2023-12-06T18:35:57.377 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.143050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143050.log.gz 2023-12-06T18:35:57.377 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138402.log 2023-12-06T18:35:57.377 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131268.log.gz 2023-12-06T18:35:57.377 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146892.log 2023-12-06T18:35:57.377 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138055.log.gz 2023-12-06T18:35:57.378 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147430.log 2023-12-06T18:35:57.378 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138402.log.gz 2023-12-06T18:35:57.378 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124162.log 2023-12-06T18:35:57.378 INFO:teuthology.orchestra.run.smithi123.stderr: 24.0% -- replaced with /var/log/ceph/ceph-client.admin.146892.log.gz 2023-12-06T18:35:57.378 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137019.log 2023-12-06T18:35:57.378 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147430.log.gz 2023-12-06T18:35:57.378 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121004.log 2023-12-06T18:35:57.378 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124162.log.gz 2023-12-06T18:35:57.379 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117767.log 2023-12-06T18:35:57.379 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137019.log.gz 2023-12-06T18:35:57.379 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121004.log.gz 2023-12-06T18:35:57.379 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137148.log 2023-12-06T18:35:57.379 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124056.log 2023-12-06T18:35:57.379 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.117767.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117767.log.gz 2023-12-06T18:35:57.379 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135207.log 2023-12-06T18:35:57.379 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137148.log.gz 2023-12-06T18:35:57.379 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135664.log 2023-12-06T18:35:57.380 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124056.log.gz 2023-12-06T18:35:57.380 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137428.log 2023-12-06T18:35:57.380 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135207.log.gz 2023-12-06T18:35:57.380 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135664.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135664.log.gz 2023-12-06T18:35:57.380 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143544.log 2023-12-06T18:35:57.380 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149699.log 2023-12-06T18:35:57.380 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137428.log.gz 2023-12-06T18:35:57.380 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.143544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137557.log 2023-12-06T18:35:57.380 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143544.log.gz 2023-12-06T18:35:57.381 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136912.log 2023-12-06T18:35:57.381 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149699.log.gz 2023-12-06T18:35:57.381 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126630.log 2023-12-06T18:35:57.381 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137557.log.gz 2023-12-06T18:35:57.381 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119793.log 2023-12-06T18:35:57.381 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136912.log.gz 2023-12-06T18:35:57.381 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122097.log 2023-12-06T18:35:57.381 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126630.log.gz 2023-12-06T18:35:57.381 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121496.log 2023-12-06T18:35:57.381 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119793.log.gz 2023-12-06T18:35:57.382 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141881.log 2023-12-06T18:35:57.382 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122097.log.gz 2023-12-06T18:35:57.382 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123540.log 2023-12-06T18:35:57.382 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121496.log.gz 2023-12-06T18:35:57.382 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142203.log 2023-12-06T18:35:57.382 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141881.log.gz 2023-12-06T18:35:57.382 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137947.log 2023-12-06T18:35:57.382 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123540.log.gz 2023-12-06T18:35:57.382 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145889.log 2023-12-06T18:35:57.383 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142203.log.gz 2023-12-06T18:35:57.383 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158800.log 2023-12-06T18:35:57.383 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137947.log.gz 2023-12-06T18:35:57.383 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138754.log 2023-12-06T18:35:57.383 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145889.log.gz 2023-12-06T18:35:57.383 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135825.log 2023-12-06T18:35:57.383 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158800.log.gz 2023-12-06T18:35:57.383 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139052.log 2023-12-06T18:35:57.384 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.138754.log.gz 2023-12-06T18:35:57.384 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150608.log 2023-12-06T18:35:57.384 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135825.log.gz 2023-12-06T18:35:57.384 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137668.log 2023-12-06T18:35:57.384 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139052.log.gz 2023-12-06T18:35:57.384 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160284.log 2023-12-06T18:35:57.384 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150608.log.gz 2023-12-06T18:35:57.384 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151026.log 2023-12-06T18:35:57.384 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137668.log.gz 2023-12-06T18:35:57.385 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157139.log 2023-12-06T18:35:57.385 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160284.log.gz 2023-12-06T18:35:57.385 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151907.log 2023-12-06T18:35:57.385 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151026.log.gz 2023-12-06T18:35:57.385 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132938.log 2023-12-06T18:35:57.385 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157139.log.gz 2023-12-06T18:35:57.385 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121206.log 2023-12-06T18:35:57.385 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151907.log.gz 2023-12-06T18:35:57.385 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132938.log.gz 2023-12-06T18:35:57.386 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138771.log 2023-12-06T18:35:57.386 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146511.log 2023-12-06T18:35:57.386 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121206.log: 5.3% -- replaced with /var/log/ceph/ceph-client.admin.121206.log.gz 2023-12-06T18:35:57.386 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146302.log 2023-12-06T18:35:57.386 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138771.log.gz 2023-12-06T18:35:57.386 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117865.log 2023-12-06T18:35:57.386 INFO:teuthology.orchestra.run.smithi123.stderr: 24.1% -- replaced with /var/log/ceph/ceph-client.admin.146511.log.gz 2023-12-06T18:35:57.386 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154434.log 2023-12-06T18:35:57.387 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146302.log.gz 2023-12-06T18:35:57.387 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.117865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133431.log 2023-12-06T18:35:57.387 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117865.log.gz 2023-12-06T18:35:57.387 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147043.log 2023-12-06T18:35:57.387 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154434.log.gz 2023-12-06T18:35:57.387 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150737.log 2023-12-06T18:35:57.387 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133431.log.gz 2023-12-06T18:35:57.387 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152552.log 2023-12-06T18:35:57.387 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147043.log.gz 2023-12-06T18:35:57.388 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150737.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.109400.log 2023-12-06T18:35:57.388 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150737.log.gz 2023-12-06T18:35:57.388 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118918.log 2023-12-06T18:35:57.388 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152552.log.gz 2023-12-06T18:35:57.388 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph.tmp-client.admin.109400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119945.log 2023-12-06T18:35:57.388 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.109400.log.gz 2023-12-06T18:35:57.388 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.118918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124499.log 2023-12-06T18:35:57.388 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118918.log.gz 2023-12-06T18:35:57.388 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143501.log 2023-12-06T18:35:57.389 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119945.log.gz 2023-12-06T18:35:57.389 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136869.log 2023-12-06T18:35:57.389 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124499.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.124499.log.gz 2023-12-06T18:35:57.389 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.143501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155952.log 2023-12-06T18:35:57.389 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143501.log.gz 2023-12-06T18:35:57.389 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151440.log 2023-12-06T18:35:57.389 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136869.log.gz 2023-12-06T18:35:57.389 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122033.log 2023-12-06T18:35:57.389 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155952.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155952.log.gz 2023-12-06T18:35:57.389 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117473.log 2023-12-06T18:35:57.390 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151440.log.gz 2023-12-06T18:35:57.390 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133345.log 2023-12-06T18:35:57.390 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122033.log.gz 2023-12-06T18:35:57.390 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.117473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129798.log 2023-12-06T18:35:57.390 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117473.log.gz 2023-12-06T18:35:57.390 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133345.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133345.log.gz 2023-12-06T18:35:57.390 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117816.log 2023-12-06T18:35:57.390 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151047.log 2023-12-06T18:35:57.391 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129798.log.gz 2023-12-06T18:35:57.391 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.117816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124482.log 2023-12-06T18:35:57.391 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117816.log.gz 2023-12-06T18:35:57.391 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130764.log 2023-12-06T18:35:57.391 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151047.log.gz 2023-12-06T18:35:57.391 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133877.log 2023-12-06T18:35:57.391 INFO:teuthology.orchestra.run.smithi123.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.124482.log.gz 2023-12-06T18:35:57.391 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133753.log 2023-12-06T18:35:57.391 INFO:teuthology.orchestra.run.smithi123.stderr: 24.3% -- replaced with /var/log/ceph/ceph-client.admin.130764.log.gz 2023-12-06T18:35:57.391 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154417.log 2023-12-06T18:35:57.392 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133877.log.gz 2023-12-06T18:35:57.392 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133753.log.gz 2023-12-06T18:35:57.392 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149327.log 2023-12-06T18:35:57.392 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154417.log.gz 2023-12-06T18:35:57.392 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152187.log 2023-12-06T18:35:57.392 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128702.log 2023-12-06T18:35:57.392 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149327.log.gz 2023-12-06T18:35:57.392 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142648.log 2023-12-06T18:35:57.392 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152187.log.gz 2023-12-06T18:35:57.393 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162417.log 2023-12-06T18:35:57.393 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128702.log.gz 2023-12-06T18:35:57.393 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157194.log 2023-12-06T18:35:57.393 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142648.log.gz 2023-12-06T18:35:57.393 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127410.log 2023-12-06T18:35:57.393 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162417.log.gz 2023-12-06T18:35:57.393 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130386.log 2023-12-06T18:35:57.393 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157194.log.gz 2023-12-06T18:35:57.393 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165986.log 2023-12-06T18:35:57.394 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127410.log.gz 2023-12-06T18:35:57.394 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126070.log 2023-12-06T18:35:57.394 INFO:teuthology.orchestra.run.smithi123.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.130386.log.gz 2023-12-06T18:35:57.394 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.165986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119735.log 2023-12-06T18:35:57.394 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165986.log.gz 2023-12-06T18:35:57.394 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147086.log 2023-12-06T18:35:57.394 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126070.log.gz 2023-12-06T18:35:57.394 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119155.log 2023-12-06T18:35:57.395 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119735.log.gz 2023-12-06T18:35:57.395 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162955.log 2023-12-06T18:35:57.395 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147086.log.gz 2023-12-06T18:35:57.395 INFO:teuthology.orchestra.run.smithi123.stderr:gzip /var/log/ceph/ceph-client.admin.119155.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.129987.log 2023-12-06T18:35:57.395 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119155.log.gz 2023-12-06T18:35:57.395 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150307.log 2023-12-06T18:35:57.395 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162955.log.gz 2023-12-06T18:35:57.395 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129987.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.129987.log.gz-- 2023-12-06T18:35:57.395 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119963.log 2023-12-06T18:35:57.396 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150307.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150307.log.gz 2023-12-06T18:35:57.396 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155757.log 2023-12-06T18:35:57.396 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123733.log 2023-12-06T18:35:57.396 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119963.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.119963.log.gz 2023-12-06T18:35:57.396 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142311.log 2023-12-06T18:35:57.396 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155757.log.gz 2023-12-06T18:35:57.396 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152810.log 2023-12-06T18:35:57.397 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123733.log.gz 2023-12-06T18:35:57.397 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123339.log 2023-12-06T18:35:57.397 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142311.log.gz 2023-12-06T18:35:57.397 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120682.log 2023-12-06T18:35:57.397 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152810.log.gz 2023-12-06T18:35:57.397 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138490.log 2023-12-06T18:35:57.397 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.123339.log.gz 2023-12-06T18:35:57.397 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142670.log 2023-12-06T18:35:57.397 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120682.log.gz 2023-12-06T18:35:57.398 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140759.log 2023-12-06T18:35:57.398 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138490.log.gz 2023-12-06T18:35:57.398 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124329.log 2023-12-06T18:35:57.398 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142670.log.gz 2023-12-06T18:35:57.398 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162524.log 2023-12-06T18:35:57.398 INFO:teuthology.orchestra.run.smithi123.stderr: 24.0% -- replaced with /var/log/ceph/ceph-client.admin.140759.log.gz 2023-12-06T18:35:57.398 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138812.log 2023-12-06T18:35:57.398 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124329.log.gz 2023-12-06T18:35:57.398 INFO:teuthology.orchestra.run.smithi123.stderr:gzip /var/log/ceph/ceph-client.admin.162524.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.134682.log 2023-12-06T18:35:57.399 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162524.log.gz 2023-12-06T18:35:57.399 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165692.log 2023-12-06T18:35:57.399 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138812.log.gz 2023-12-06T18:35:57.399 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152681.log 2023-12-06T18:35:57.399 INFO:teuthology.orchestra.run.smithi123.stderr: 54.2% -- replaced with /var/log/ceph/ceph-client.admin.134682.log.gz 2023-12-06T18:35:57.399 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.165692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146679.log 2023-12-06T18:35:57.399 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165692.log.gz 2023-12-06T18:35:57.399 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129945.log 2023-12-06T18:35:57.399 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152681.log.gz 2023-12-06T18:35:57.400 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127910.log 2023-12-06T18:35:57.400 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146679.log.gz 2023-12-06T18:35:57.400 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155493.log 2023-12-06T18:35:57.400 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129945.log.gz 2023-12-06T18:35:57.400 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125230.log 2023-12-06T18:35:57.400 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127910.log.gz 2023-12-06T18:35:57.400 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157434.log 2023-12-06T18:35:57.400 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155493.log.gz 2023-12-06T18:35:57.400 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148685.log 2023-12-06T18:35:57.401 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125230.log.gz 2023-12-06T18:35:57.401 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137127.log 2023-12-06T18:35:57.401 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157434.log.gz 2023-12-06T18:35:57.401 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129127.log 2023-12-06T18:35:57.401 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148685.log.gz 2023-12-06T18:35:57.401 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128243.log 2023-12-06T18:35:57.401 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137127.log.gz 2023-12-06T18:35:57.401 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128634.log 2023-12-06T18:35:57.401 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129127.log.gz 2023-12-06T18:35:57.401 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143587.log 2023-12-06T18:35:57.402 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128243.log.gz 2023-12-06T18:35:57.402 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149370.log 2023-12-06T18:35:57.402 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128634.log.gz 2023-12-06T18:35:57.402 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.143587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162266.log 2023-12-06T18:35:57.402 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143587.log.gz 2023-12-06T18:35:57.402 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132051.log 2023-12-06T18:35:57.402 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149370.log.gz 2023-12-06T18:35:57.402 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160047.log 2023-12-06T18:35:57.402 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162266.log.gz 2023-12-06T18:35:57.403 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123583.log 2023-12-06T18:35:57.403 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132051.log.gz 2023-12-06T18:35:57.403 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136890.log 2023-12-06T18:35:57.403 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160047.log.gz 2023-12-06T18:35:57.403 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156323.log 2023-12-06T18:35:57.403 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123583.log.gz 2023-12-06T18:35:57.403 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145153.log 2023-12-06T18:35:57.403 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136890.log.gz 2023-12-06T18:35:57.403 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135417.log 2023-12-06T18:35:57.404 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156323.log.gz 2023-12-06T18:35:57.404 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153197.log 2023-12-06T18:35:57.404 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145153.log.gz 2023-12-06T18:35:57.404 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119602.log 2023-12-06T18:35:57.404 INFO:teuthology.orchestra.run.smithi123.stderr: 56.6% -- replaced with /var/log/ceph/ceph-client.admin.135417.log.gz 2023-12-06T18:35:57.404 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156937.log 2023-12-06T18:35:57.404 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153197.log.gz 2023-12-06T18:35:57.404 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161267.log 2023-12-06T18:35:57.404 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119602.log.gz 2023-12-06T18:35:57.405 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161332.log 2023-12-06T18:35:57.405 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156937.log.gz 2023-12-06T18:35:57.405 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136847.log 2023-12-06T18:35:57.405 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161267.log.gz 2023-12-06T18:35:57.405 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156559.log 2023-12-06T18:35:57.405 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161332.log.gz 2023-12-06T18:35:57.405 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142375.log 2023-12-06T18:35:57.405 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136847.log.gz 2023-12-06T18:35:57.405 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134063.log 2023-12-06T18:35:57.406 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156559.log.gz 2023-12-06T18:35:57.406 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142375.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142375.log.gz 2023-12-06T18:35:57.406 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160112.log 2023-12-06T18:35:57.406 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134063.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134063.log.gz 2023-12-06T18:35:57.406 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159811.log 2023-12-06T18:35:57.406 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127450.log 2023-12-06T18:35:57.406 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160112.log.gz 2023-12-06T18:35:57.406 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162546.log 2023-12-06T18:35:57.406 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159811.log.gz 2023-12-06T18:35:57.407 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130848.log 2023-12-06T18:35:57.407 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127450.log.gz 2023-12-06T18:35:57.407 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148076.log 2023-12-06T18:35:57.407 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162546.log.gz 2023-12-06T18:35:57.407 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148833.log 2023-12-06T18:35:57.407 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130848.log.gz 2023-12-06T18:35:57.407 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151864.log 2023-12-06T18:35:57.407 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148076.log.gz 2023-12-06T18:35:57.407 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148833.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148833.log.gz 2023-12-06T18:35:57.408 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123129.log 2023-12-06T18:35:57.408 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148412.log 2023-12-06T18:35:57.408 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151864.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151864.log.gz 2023-12-06T18:35:57.408 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125876.log /var/log/ceph/ceph-client.admin.123129.log: 2023-12-06T18:35:57.408 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123129.log.gz 2023-12-06T18:35:57.408 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119621.log 2023-12-06T18:35:57.408 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148412.log.gz 2023-12-06T18:35:57.408 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128294.log 2023-12-06T18:35:57.408 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125876.log.gz 2023-12-06T18:35:57.408 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145325.log 2023-12-06T18:35:57.409 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.119621.log.gz 2023-12-06T18:35:57.409 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155318.log 2023-12-06T18:35:57.409 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128294.log.gz 2023-12-06T18:35:57.409 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139697.log 2023-12-06T18:35:57.409 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145325.log.gz 2023-12-06T18:35:57.409 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143566.log 2023-12-06T18:35:57.409 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155318.log.gz 2023-12-06T18:35:57.409 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133939.log 2023-12-06T18:35:57.409 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139697.log.gz 2023-12-06T18:35:57.410 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.143566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159961.log 2023-12-06T18:35:57.410 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143566.log.gz 2023-12-06T18:35:57.410 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158509.log 2023-12-06T18:35:57.410 INFO:teuthology.orchestra.run.smithi123.stderr: 57.5% -- replaced with /var/log/ceph/ceph-client.admin.133939.log.gz 2023-12-06T18:35:57.410 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135882.log 2023-12-06T18:35:57.410 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159961.log.gz 2023-12-06T18:35:57.410 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123067.log 2023-12-06T18:35:57.410 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158509.log.gz 2023-12-06T18:35:57.410 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147215.log 2023-12-06T18:35:57.411 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135882.log.gz 2023-12-06T18:35:57.411 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154902.log 2023-12-06T18:35:57.411 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123067.log.gz 2023-12-06T18:35:57.411 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124278.log 2023-12-06T18:35:57.411 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147215.log.gz 2023-12-06T18:35:57.411 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135185.log 2023-12-06T18:35:57.411 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154902.log.gz 2023-12-06T18:35:57.411 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124601.log 2023-12-06T18:35:57.411 INFO:teuthology.orchestra.run.smithi123.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.124278.log.gz 2023-12-06T18:35:57.412 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159660.log 2023-12-06T18:35:57.412 INFO:teuthology.orchestra.run.smithi123.stderr: 55.0% -- replaced with /var/log/ceph/ceph-client.admin.135185.log.gz 2023-12-06T18:35:57.412 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154377.log 2023-12-06T18:35:57.412 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124601.log.gz 2023-12-06T18:35:57.412 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121883.log 2023-12-06T18:35:57.412 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159660.log.gz 2023-12-06T18:35:57.412 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157971.log 2023-12-06T18:35:57.412 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154377.log.gz 2023-12-06T18:35:57.412 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160463.log 2023-12-06T18:35:57.412 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121883.log.gz 2023-12-06T18:35:57.413 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142525.log 2023-12-06T18:35:57.413 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157971.log.gz 2023-12-06T18:35:57.413 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157649.log 2023-12-06T18:35:57.413 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160463.log.gz 2023-12-06T18:35:57.413 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145848.log 2023-12-06T18:35:57.413 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142525.log.gz 2023-12-06T18:35:57.413 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160363.log 2023-12-06T18:35:57.413 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157649.log.gz 2023-12-06T18:35:57.413 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132309.log 2023-12-06T18:35:57.414 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145848.log.gz 2023-12-06T18:35:57.414 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129212.log 2023-12-06T18:35:57.414 INFO:teuthology.orchestra.run.smithi123.stderr: 13.6% -- replaced with /var/log/ceph/ceph-client.admin.160363.log.gz 2023-12-06T18:35:57.414 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154745.log 2023-12-06T18:35:57.414 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132309.log.gz 2023-12-06T18:35:57.414 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129467.log 2023-12-06T18:35:57.414 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129212.log.gz 2023-12-06T18:35:57.414 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150968.log 2023-12-06T18:35:57.415 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154745.log.gz 2023-12-06T18:35:57.415 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123776.log 2023-12-06T18:35:57.415 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129467.log.gz 2023-12-06T18:35:57.415 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136741.log 2023-12-06T18:35:57.415 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150968.log.gz 2023-12-06T18:35:57.415 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156223.log 2023-12-06T18:35:57.415 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123776.log.gz 2023-12-06T18:35:57.415 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154357.log 2023-12-06T18:35:57.415 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136741.log.gz 2023-12-06T18:35:57.416 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150457.log 2023-12-06T18:35:57.416 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156223.log.gz 2023-12-06T18:35:57.416 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132094.log 2023-12-06T18:35:57.416 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154357.log.gz 2023-12-06T18:35:57.416 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148097.log 2023-12-06T18:35:57.416 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150457.log.gz 2023-12-06T18:35:57.416 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132094.log.gz 2023-12-06T18:35:57.416 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145749.log 2023-12-06T18:35:57.416 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126870.log 2023-12-06T18:35:57.417 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148097.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148097.log.gz 2023-12-06T18:35:57.417 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142289.log 2023-12-06T18:35:57.417 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145749.log.gz 2023-12-06T18:35:57.417 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134001.log 2023-12-06T18:35:57.417 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126870.log.gz 2023-12-06T18:35:57.417 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139654.log 2023-12-06T18:35:57.417 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142289.log.gz 2023-12-06T18:35:57.417 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125990.log 2023-12-06T18:35:57.417 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134001.log.gz 2023-12-06T18:35:57.418 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154570.log 2023-12-06T18:35:57.418 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139654.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139654.log.gz 2023-12-06T18:35:57.418 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141902.log 2023-12-06T18:35:57.418 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125990.log.gz 2023-12-06T18:35:57.418 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134565.log 2023-12-06T18:35:57.418 INFO:teuthology.orchestra.run.smithi123.stderr: 54.6% -- replaced with /var/log/ceph/ceph-client.admin.154570.log.gz 2023-12-06T18:35:57.418 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156692.log 2023-12-06T18:35:57.418 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141902.log.gz 2023-12-06T18:35:57.418 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152982.log 2023-12-06T18:35:57.419 INFO:teuthology.orchestra.run.smithi123.stderr: 51.3% -- replaced with /var/log/ceph/ceph-client.admin.134565.log.gz 2023-12-06T18:35:57.419 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121128.log 2023-12-06T18:35:57.419 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156692.log.gz 2023-12-06T18:35:57.419 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132503.log 2023-12-06T18:35:57.419 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152982.log.gz 2023-12-06T18:35:57.419 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124686.log 2023-12-06T18:35:57.419 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121128.log.gz 2023-12-06T18:35:57.419 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145608.log 2023-12-06T18:35:57.419 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132503.log.gz 2023-12-06T18:35:57.419 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123109.log 2023-12-06T18:35:57.420 INFO:teuthology.orchestra.run.smithi123.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.124686.log.gz 2023-12-06T18:35:57.420 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128583.log 2023-12-06T18:35:57.420 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145608.log.gz 2023-12-06T18:35:57.420 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123238.log 2023-12-06T18:35:57.420 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123109.log.gz 2023-12-06T18:35:57.420 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129637.log 2023-12-06T18:35:57.420 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128583.log.gz 2023-12-06T18:35:57.421 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160936.log 2023-12-06T18:35:57.421 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123238.log.gz 2023-12-06T18:35:57.421 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135685.log 2023-12-06T18:35:57.421 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129637.log.gz 2023-12-06T18:35:57.421 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129416.log 2023-12-06T18:35:57.422 INFO:teuthology.orchestra.run.smithi123.stderr: 11.1% -- replaced with /var/log/ceph/ceph-client.admin.160936.log.gz 2023-12-06T18:35:57.422 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114265.log 2023-12-06T18:35:57.422 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135685.log.gz 2023-12-06T18:35:57.422 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152853.log 2023-12-06T18:35:57.422 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129416.log.gz 2023-12-06T18:35:57.422 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.114265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134875.log 2023-12-06T18:35:57.422 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114265.log.gz 2023-12-06T18:35:57.422 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122957.log 2023-12-06T18:35:57.422 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152853.log.gz 2023-12-06T18:35:57.423 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148350.log 2023-12-06T18:35:57.423 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134875.log.gz 2023-12-06T18:35:57.423 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160816.log 2023-12-06T18:35:57.423 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122957.log.gz 2023-12-06T18:35:57.423 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130113.log 2023-12-06T18:35:57.423 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148350.log.gz 2023-12-06T18:35:57.423 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131541.log 2023-12-06T18:35:57.423 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160816.log.gz 2023-12-06T18:35:57.423 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131478.log 2023-12-06T18:35:57.424 INFO:teuthology.orchestra.run.smithi123.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.130113.log.gz 2023-12-06T18:35:57.424 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159101.log 2023-12-06T18:35:57.424 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131541.log.gz 2023-12-06T18:35:57.424 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146427.log 2023-12-06T18:35:57.424 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131478.log.gz 2023-12-06T18:35:57.424 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162137.log 2023-12-06T18:35:57.424 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159101.log.gz 2023-12-06T18:35:57.424 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124822.log 2023-12-06T18:35:57.424 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146427.log.gz 2023-12-06T18:35:57.425 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124737.log 2023-12-06T18:35:57.425 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162137.log.gz 2023-12-06T18:35:57.425 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131247.log 2023-12-06T18:35:57.425 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124822.log.gz 2023-12-06T18:35:57.425 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149819.log 2023-12-06T18:35:57.425 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124737.log.gz 2023-12-06T18:35:57.425 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141514.log 2023-12-06T18:35:57.425 INFO:teuthology.orchestra.run.smithi123.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.131247.log.gz 2023-12-06T18:35:57.425 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128464.log 2023-12-06T18:35:57.426 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149819.log.gz 2023-12-06T18:35:57.426 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161633.log 2023-12-06T18:35:57.426 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141514.log.gz 2023-12-06T18:35:57.426 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138033.log 2023-12-06T18:35:57.426 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128464.log.gz 2023-12-06T18:35:57.426 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161633.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161633.log.gz 2023-12-06T18:35:57.426 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119596.log 2023-12-06T18:35:57.426 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135643.log 2023-12-06T18:35:57.426 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138033.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138033.log.gz 2023-12-06T18:35:57.427 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128175.log 2023-12-06T18:35:57.427 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119596.log.gz 2023-12-06T18:35:57.427 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145540.log 2023-12-06T18:35:57.427 INFO:teuthology.orchestra.run.smithi123.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.135643.log.gz 2023-12-06T18:35:57.427 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128957.log 2023-12-06T18:35:57.427 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128175.log.gz 2023-12-06T18:35:57.427 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160611.log 2023-12-06T18:35:57.427 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145540.log.gz 2023-12-06T18:35:57.428 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127390.log 2023-12-06T18:35:57.428 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128957.log.gz 2023-12-06T18:35:57.428 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122828.log 2023-12-06T18:35:57.428 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160611.log.gz 2023-12-06T18:35:57.428 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158367.log 2023-12-06T18:35:57.428 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127390.log.gz 2023-12-06T18:35:57.428 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161867.log 2023-12-06T18:35:57.428 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122828.log.gz 2023-12-06T18:35:57.428 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125842.log 2023-12-06T18:35:57.429 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158367.log.gz 2023-12-06T18:35:57.429 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131815.log 2023-12-06T18:35:57.429 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161867.log.gz 2023-12-06T18:35:57.429 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131646.log 2023-12-06T18:35:57.429 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125842.log.gz 2023-12-06T18:35:57.429 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138561.log 2023-12-06T18:35:57.429 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131815.log.gz 2023-12-06T18:35:57.429 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135353.log 2023-12-06T18:35:57.429 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131646.log.gz 2023-12-06T18:35:57.430 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138248.log 2023-12-06T18:35:57.430 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138561.log.gz 2023-12-06T18:35:57.430 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165243.log 2023-12-06T18:35:57.430 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135353.log.gz 2023-12-06T18:35:57.430 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140425.log 2023-12-06T18:35:57.430 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138248.log.gz 2023-12-06T18:35:57.430 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.165243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136441.log 2023-12-06T18:35:57.430 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165243.log.gz 2023-12-06T18:35:57.430 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119480.log 2023-12-06T18:35:57.431 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140425.log.gz 2023-12-06T18:35:57.431 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128090.log 2023-12-06T18:35:57.431 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136441.log.gz 2023-12-06T18:35:57.431 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157098.log 2023-12-06T18:35:57.431 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.119480.log.gz 2023-12-06T18:35:57.431 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128090.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128090.log.gz 2023-12-06T18:35:57.431 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156126.log 2023-12-06T18:35:57.431 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124414.log 2023-12-06T18:35:57.431 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157098.log.gz 2023-12-06T18:35:57.432 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148983.log 2023-12-06T18:35:57.432 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156126.log.gz 2023-12-06T18:35:57.432 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152466.log 2023-12-06T18:35:57.432 INFO:teuthology.orchestra.run.smithi123.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.124414.log.gz 2023-12-06T18:35:57.432 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141321.log 2023-12-06T18:35:57.432 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148983.log.gz 2023-12-06T18:35:57.432 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122377.log 2023-12-06T18:35:57.432 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152466.log.gz 2023-12-06T18:35:57.432 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135482.log 2023-12-06T18:35:57.433 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141321.log.gz 2023-12-06T18:35:57.433 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122936.log 2023-12-06T18:35:57.433 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122377.log.gz 2023-12-06T18:35:57.433 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156009.log 2023-12-06T18:35:57.433 INFO:teuthology.orchestra.run.smithi123.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.135482.log.gz 2023-12-06T18:35:57.433 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118853.log 2023-12-06T18:35:57.433 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122936.log.gz 2023-12-06T18:35:57.433 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166035.log 0.0% 2023-12-06T18:35:57.433 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.156009.log.gz 2023-12-06T18:35:57.433 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.118853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125723.log 2023-12-06T18:35:57.434 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118853.log.gz 2023-12-06T18:35:57.434 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.166035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145828.log 2023-12-06T18:35:57.434 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166035.log.gz 2023-12-06T18:35:57.434 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145282.log 2023-12-06T18:35:57.434 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125723.log.gz 2023-12-06T18:35:57.434 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156857.log 2023-12-06T18:35:57.434 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145828.log.gz 2023-12-06T18:35:57.434 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158994.log 2023-12-06T18:35:57.435 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145282.log.gz 2023-12-06T18:35:57.435 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159897.log 2023-12-06T18:35:57.435 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156857.log.gz 2023-12-06T18:35:57.435 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158865.log 2023-12-06T18:35:57.435 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158994.log.gz 2023-12-06T18:35:57.435 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150006.log 2023-12-06T18:35:57.435 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159897.log.gz 2023-12-06T18:35:57.435 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152509.log 2023-12-06T18:35:57.435 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158865.log.gz 2023-12-06T18:35:57.436 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157455.log 2023-12-06T18:35:57.436 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150006.log.gz 2023-12-06T18:35:57.436 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159940.log 2023-12-06T18:35:57.436 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152509.log.gz 2023-12-06T18:35:57.436 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149919.log 2023-12-06T18:35:57.436 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157455.log.gz 2023-12-06T18:35:57.436 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146658.log 2023-12-06T18:35:57.436 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159940.log.gz 2023-12-06T18:35:57.436 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147624.log 2023-12-06T18:35:57.437 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149919.log.gz 2023-12-06T18:35:57.437 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160956.log 2023-12-06T18:35:57.437 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146658.log.gz 2023-12-06T18:35:57.437 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128447.log 2023-12-06T18:35:57.437 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147624.log.gz 2023-12-06T18:35:57.437 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136641.log 2023-12-06T18:35:57.437 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160956.log.gz 2023-12-06T18:35:57.437 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160133.log 2023-12-06T18:35:57.437 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128447.log.gz 2023-12-06T18:35:57.437 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118939.log 2023-12-06T18:35:57.438 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136641.log.gz 2023-12-06T18:35:57.438 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128158.log 2023-12-06T18:35:57.438 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160133.log.gz 2023-12-06T18:35:57.438 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.118939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124013.log 2023-12-06T18:35:57.438 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118939.log.gz 2023-12-06T18:35:57.438 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119373.log 2023-12-06T18:35:57.438 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128158.log.gz 2023-12-06T18:35:57.438 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132816.log 2023-12-06T18:35:57.438 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124013.log.gz 2023-12-06T18:35:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135461.log 2023-12-06T18:35:57.439 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119373.log.gz 2023-12-06T18:35:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147667.log 2023-12-06T18:35:57.439 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132816.log.gz 2023-12-06T18:35:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155798.log 2023-12-06T18:35:57.439 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135461.log.gz 2023-12-06T18:35:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158100.log 2023-12-06T18:35:57.439 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147667.log.gz 2023-12-06T18:35:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136462.log 2023-12-06T18:35:57.440 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155798.log.gz 2023-12-06T18:35:57.440 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136242.log 2023-12-06T18:35:57.440 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158100.log.gz 2023-12-06T18:35:57.440 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127270.log 2023-12-06T18:35:57.440 INFO:teuthology.orchestra.run.smithi123.stderr: 24.3% -- replaced with /var/log/ceph/ceph-client.admin.136462.log.gz 2023-12-06T18:35:57.440 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125757.log 2023-12-06T18:35:57.440 INFO:teuthology.orchestra.run.smithi123.stderr: 24.3% -- replaced with /var/log/ceph/ceph-client.admin.136242.log.gz 2023-12-06T18:35:57.440 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127150.log 2023-12-06T18:35:57.440 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127270.log.gz 2023-12-06T18:35:57.441 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151244.log 2023-12-06T18:35:57.441 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125757.log.gz 2023-12-06T18:35:57.441 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149220.log 2023-12-06T18:35:57.441 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127150.log.gz 2023-12-06T18:35:57.441 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131121.log 2023-12-06T18:35:57.441 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151244.log.gz 2023-12-06T18:35:57.441 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131520.log 2023-12-06T18:35:57.441 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149220.log.gz 2023-12-06T18:35:57.441 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132030.log 2023-12-06T18:35:57.442 INFO:teuthology.orchestra.run.smithi123.stderr: 24.3% -- replaced with /var/log/ceph/ceph-client.admin.131121.log.gz 2023-12-06T18:35:57.442 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162696.log 2023-12-06T18:35:57.442 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131520.log.gz 2023-12-06T18:35:57.442 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124516.log 2023-12-06T18:35:57.442 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132030.log.gz 2023-12-06T18:35:57.442 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156635.log 2023-12-06T18:35:57.442 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162696.log.gz 2023-12-06T18:35:57.442 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165079.log 2023-12-06T18:35:57.442 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124516.log.gz 2023-12-06T18:35:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133087.log 2023-12-06T18:35:57.443 INFO:teuthology.orchestra.run.smithi123.stderr: 53.3% -- replaced with /var/log/ceph/ceph-client.admin.156635.log.gz 2023-12-06T18:35:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.165079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130092.log 2023-12-06T18:35:57.443 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165079.log.gz 2023-12-06T18:35:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121604.log 2023-12-06T18:35:57.443 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133087.log.gz 2023-12-06T18:35:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130092.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-12-06T18:35:57.443 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130092.log.gz 2023-12-06T18:35:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148140.log 2023-12-06T18:35:57.444 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121604.log.gz 2023-12-06T18:35:57.444 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142942.log 2023-12-06T18:35:57.444 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129735.log 2023-12-06T18:35:57.444 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148140.log.gz 2023-12-06T18:35:57.444 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142942.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142942.log.gz 2023-12-06T18:35:57.444 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119755.log 2023-12-06T18:35:57.444 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134084.log 2023-12-06T18:35:57.444 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129735.log.gz 2023-12-06T18:35:57.444 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119755.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119755.log.gz 2023-12-06T18:35:57.444 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131436.log 2023-12-06T18:35:57.445 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138967.log 2023-12-06T18:35:57.445 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134084.log: 56.8% -- replaced with /var/log/ceph/ceph-client.admin.134084.log.gz/var/log/ceph/ceph-client.admin.131436.log: 2023-12-06T18:35:57.445 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155104.log 2023-12-06T18:35:57.445 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131436.log.gz 2023-12-06T18:35:57.445 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148962.log 2023-12-06T18:35:57.445 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138967.log.gz 2023-12-06T18:35:57.445 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155104.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155104.log.gz 2023-12-06T18:35:57.445 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129501.log 2023-12-06T18:35:57.446 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148962.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148962.log.gz 2023-12-06T18:35:57.446 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129756.log 2023-12-06T18:35:57.446 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158652.log 2023-12-06T18:35:57.446 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129501.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129501.log.gz 2023-12-06T18:35:57.446 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155911.log 2023-12-06T18:35:57.446 INFO:teuthology.orchestra.run.smithi123.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.129756.log.gz 2023-12-06T18:35:57.446 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161095.log 2023-12-06T18:35:57.446 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158652.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158652.log.gz 2023-12-06T18:35:57.446 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149499.log 2023-12-06T18:35:57.447 INFO:teuthology.orchestra.run.smithi123.stderr: 51.1% -- replaced with /var/log/ceph/ceph-client.admin.155911.log.gz 2023-12-06T18:35:57.447 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161095.log.gz 2023-12-06T18:35:57.447 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128532.log 2023-12-06T18:35:57.447 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125570.log 2023-12-06T18:35:57.447 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149499.log.gz 2023-12-06T18:35:57.447 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144401.log 2023-12-06T18:35:57.447 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128532.log.gz 2023-12-06T18:35:57.447 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141708.log 2023-12-06T18:35:57.447 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125570.log.gz 2023-12-06T18:35:57.448 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.144401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146957.log 2023-12-06T18:35:57.448 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144401.log.gz 2023-12-06T18:35:57.448 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123862.log 2023-12-06T18:35:57.448 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141708.log.gz 2023-12-06T18:35:57.448 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132524.log 2023-12-06T18:35:57.448 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146957.log.gz 2023-12-06T18:35:57.448 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127730.log 2023-12-06T18:35:57.448 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123862.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123862.log.gz 2023-12-06T18:35:57.448 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139633.log 2023-12-06T18:35:57.448 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132524.log.gz 2023-12-06T18:35:57.449 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141622.log 2023-12-06T18:35:57.449 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127730.log.gz 2023-12-06T18:35:57.449 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122764.log 2023-12-06T18:35:57.449 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139633.log.gz 2023-12-06T18:35:57.449 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159768.log 2023-12-06T18:35:57.449 INFO:teuthology.orchestra.run.smithi123.stderr: 24.6% -- replaced with /var/log/ceph/ceph-client.admin.141622.log.gz 2023-12-06T18:35:57.449 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122764.log.gz 2023-12-06T18:35:57.449 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125451.log 2023-12-06T18:35:57.449 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159467.log 2023-12-06T18:35:57.450 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159768.log.gz 2023-12-06T18:35:57.450 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136221.log 2023-12-06T18:35:57.450 INFO:teuthology.orchestra.run.smithi123.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.125451.log.gz 2023-12-06T18:35:57.450 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159467.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.154689.log 2023-12-06T18:35:57.450 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.159467.log.gz 2023-12-06T18:35:57.450 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136221.log: 24.0% -- replaced with /var/log/ceph/ceph-client.admin.136221.log.gz 2023-12-06T18:35:57.450 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154689.log.gz 2023-12-06T18:35:57.450 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140350.log 2023-12-06T18:35:57.450 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114216.log 2023-12-06T18:35:57.451 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146116.log 2023-12-06T18:35:57.451 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140350.log.gz 2023-12-06T18:35:57.451 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.114216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120639.log 2023-12-06T18:35:57.451 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114216.log.gz 2023-12-06T18:35:57.451 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132481.log 2023-12-06T18:35:57.451 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146116.log.gz 2023-12-06T18:35:57.451 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147451.log 2023-12-06T18:35:57.451 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120639.log.gz 2023-12-06T18:35:57.451 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132481.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.132481.log.gz-- 2023-12-06T18:35:57.452 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133646.log 2023-12-06T18:35:57.452 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147451.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.147451.log.gz--verbose 2023-12-06T18:35:57.452 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.141838.log 2023-12-06T18:35:57.452 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133646.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.133646.log.gz--verbose 2023-12-06T18:35:57.452 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.127850.log 2023-12-06T18:35:57.452 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162825.log 2023-12-06T18:35:57.452 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141838.log.gz 2023-12-06T18:35:57.452 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156163.log 2023-12-06T18:35:57.452 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127850.log.gz 2023-12-06T18:35:57.452 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133560.log 2023-12-06T18:35:57.453 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162825.log.gz 2023-12-06T18:35:57.453 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141557.log 2023-12-06T18:35:57.453 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156163.log.gz 2023-12-06T18:35:57.453 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148183.log 2023-12-06T18:35:57.453 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133560.log.gz 2023-12-06T18:35:57.453 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140635.log 2023-12-06T18:35:57.453 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141557.log.gz 2023-12-06T18:35:57.453 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158779.log 2023-12-06T18:35:57.453 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148183.log.gz 2023-12-06T18:35:57.454 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140635.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.159080.log 2023-12-06T18:35:57.454 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.140635.log.gz 2023-12-06T18:35:57.454 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114030.log 2023-12-06T18:35:57.454 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158779.log.gz 2023-12-06T18:35:57.454 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154509.log 2023-12-06T18:35:57.454 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159080.log.gz 2023-12-06T18:35:57.454 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.114030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155161.log 2023-12-06T18:35:57.454 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114030.log.gz 2023-12-06T18:35:57.454 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154509.log: gzip -5 0.0%--verbose -- replaced with /var/log/ceph/ceph-client.admin.154509.log.gz-- 2023-12-06T18:35:57.455 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.165741.log 2023-12-06T18:35:57.455 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154239.log 2023-12-06T18:35:57.455 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155161.log.gz 2023-12-06T18:35:57.455 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.165741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165741.log.gz 2023-12-06T18:35:57.455 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131667.log 2023-12-06T18:35:57.455 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121582.log 2023-12-06T18:35:57.455 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154239.log.gz 2023-12-06T18:35:57.455 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131667.log: gzip -5 --verbose 0.0%-- -- replaced with /var/log/ceph/ceph-client.admin.131667.log.gz/var/log/ceph/ceph-client.admin.124098.log 2023-12-06T18:35:57.456 INFO:teuthology.orchestra.run.smithi123.stderr: 2023-12-06T18:35:57.456 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119177.log 2023-12-06T18:35:57.456 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121582.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121582.log.gz 2023-12-06T18:35:57.456 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125553.log 2023-12-06T18:35:57.456 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124098.log.gz 2023-12-06T18:35:57.456 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149604.log 2023-12-06T18:35:57.456 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119177.log.gz 2023-12-06T18:35:57.456 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124890.log 2023-12-06T18:35:57.456 INFO:teuthology.orchestra.run.smithi123.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.125553.log.gz 2023-12-06T18:35:57.457 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149604.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.149604.log.gz--verbose 2023-12-06T18:35:57.457 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.149026.log 2023-12-06T18:35:57.457 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145688.log 2023-12-06T18:35:57.457 INFO:teuthology.orchestra.run.smithi123.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.124890.log.gz 2023-12-06T18:35:57.457 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149026.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149026.log.gz 2023-12-06T18:35:57.457 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126950.log 2023-12-06T18:35:57.457 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129903.log 2023-12-06T18:35:57.457 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145688.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145688.log.gz 2023-12-06T18:35:57.457 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126950.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.126950.log.gz--verbose 2023-12-06T18:35:57.458 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.145771.log 2023-12-06T18:35:57.458 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152939.log 2023-12-06T18:35:57.458 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129903.log.gz 2023-12-06T18:35:57.458 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145771.log.gz 2023-12-06T18:35:57.458 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146785.log 2023-12-06T18:35:57.458 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154260.log 2023-12-06T18:35:57.458 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152939.log.gz 2023-12-06T18:35:57.458 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146785.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146785.log.gz 2023-12-06T18:35:57.458 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147732.log 2023-12-06T18:35:57.459 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137062.log 2023-12-06T18:35:57.459 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154260.log.gz 2023-12-06T18:35:57.459 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149837.log 2023-12-06T18:35:57.459 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147732.log.gz 2023-12-06T18:35:57.459 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131944.log 2023-12-06T18:35:57.459 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137062.log.gz 2023-12-06T18:35:57.459 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151993.log 2023-12-06T18:35:57.459 INFO:teuthology.orchestra.run.smithi123.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.149837.log.gz 2023-12-06T18:35:57.459 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134524.log 2023-12-06T18:35:57.460 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131944.log.gz 2023-12-06T18:35:57.460 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151993.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151993.log.gz 2023-12-06T18:35:57.460 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122613.log 2023-12-06T18:35:57.460 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146532.log 2023-12-06T18:35:57.460 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134524.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134524.log.gz 2023-12-06T18:35:57.460 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151645.log 2023-12-06T18:35:57.460 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122613.log.gz 2023-12-06T18:35:57.460 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156106.log 2023-12-06T18:35:57.460 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.146532.log.gz 2023-12-06T18:35:57.461 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139160.log 2023-12-06T18:35:57.461 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151645.log.gz 2023-12-06T18:35:57.461 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120488.log 2023-12-06T18:35:57.461 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156106.log.gz 2023-12-06T18:35:57.461 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128005.log 2023-12-06T18:35:57.461 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139160.log.gz 2023-12-06T18:35:57.461 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124567.log 2023-12-06T18:35:57.461 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120488.log.gz 2023-12-06T18:35:57.461 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122248.log 2023-12-06T18:35:57.461 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128005.log.gz 2023-12-06T18:35:57.462 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157477.log 2023-12-06T18:35:57.462 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124567.log.gz 2023-12-06T18:35:57.462 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162503.log 2023-12-06T18:35:57.462 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122248.log.gz 2023-12-06T18:35:57.462 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140111.log 2023-12-06T18:35:57.462 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157477.log.gz 2023-12-06T18:35:57.462 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162503.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162503.log.gz 2023-12-06T18:35:57.462 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150629.log 2023-12-06T18:35:57.462 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118617.log 2023-12-06T18:35:57.463 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140111.log.gz 2023-12-06T18:35:57.463 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150629.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150629.log.gz 2023-12-06T18:35:57.463 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159037.log 2023-12-06T18:35:57.463 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.118617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124448.log 2023-12-06T18:35:57.463 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118617.log.gz 2023-12-06T18:35:57.463 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147904.log 2023-12-06T18:35:57.463 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159037.log.gz 2023-12-06T18:35:57.463 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126170.log 2023-12-06T18:35:57.463 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124448.log.gz 2023-12-06T18:35:57.464 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147904.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147904.log.gz 2023-12-06T18:35:57.464 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154279.log 2023-12-06T18:35:57.464 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127810.log 2023-12-06T18:35:57.464 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126170.log.gz 2023-12-06T18:35:57.464 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161932.log 2023-12-06T18:35:57.464 INFO:teuthology.orchestra.run.smithi123.stderr: 57.7% -- replaced with /var/log/ceph/ceph-client.admin.154279.log.gz 2023-12-06T18:35:57.464 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127810.log.gz 2023-12-06T18:35:57.464 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151520.log 2023-12-06T18:35:57.464 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145217.log 2023-12-06T18:35:57.464 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161932.log.gz 2023-12-06T18:35:57.465 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158551.log 2023-12-06T18:35:57.465 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151520.log.gz 2023-12-06T18:35:57.465 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140956.log 2023-12-06T18:35:57.465 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145217.log.gz 2023-12-06T18:35:57.465 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158551.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.158551.log.gz/var/log/ceph/ceph-client.admin.140212.log 2023-12-06T18:35:57.465 INFO:teuthology.orchestra.run.smithi123.stderr: 2023-12-06T18:35:57.465 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139611.log 2023-12-06T18:35:57.465 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140956.log.gz 2023-12-06T18:35:57.466 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158201.log 2023-12-06T18:35:57.466 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140212.log.gz 2023-12-06T18:35:57.466 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139611.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.139867.log 2023-12-06T18:35:57.466 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.139611.log.gz 2023-12-06T18:35:57.466 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130428.log 2023-12-06T18:35:57.466 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158201.log.gz 2023-12-06T18:35:57.466 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139867.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139867.log.gz 2023-12-06T18:35:57.466 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138141.log 2023-12-06T18:35:57.466 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133173.log 2023-12-06T18:35:57.467 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130428.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130428.log.gz 2023-12-06T18:35:57.467 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137840.log 2023-12-06T18:35:57.467 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138141.log.gz 2023-12-06T18:35:57.467 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133173.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.133173.log.gz/var/log/ceph/ceph-client.admin.139787.log 2023-12-06T18:35:57.467 INFO:teuthology.orchestra.run.smithi123.stderr: 2023-12-06T18:35:57.467 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150522.log 2023-12-06T18:35:57.467 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137840.log.gz 2023-12-06T18:35:57.467 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136762.log 2023-12-06T18:35:57.467 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139787.log.gz 2023-12-06T18:35:57.468 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137299.log 2023-12-06T18:35:57.468 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150522.log.gz 2023-12-06T18:35:57.468 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154197.log 2023-12-06T18:35:57.468 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136762.log.gz 2023-12-06T18:35:57.468 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126350.log 2023-12-06T18:35:57.468 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137299.log.gz 2023-12-06T18:35:57.468 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130008.log 2023-12-06T18:35:57.468 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154197.log.gz 2023-12-06T18:35:57.468 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124584.log 2023-12-06T18:35:57.468 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126350.log.gz 2023-12-06T18:35:57.469 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130008.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130008.log.gz 2023-12-06T18:35:57.469 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133517.log 2023-12-06T18:35:57.469 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137861.log 2023-12-06T18:35:57.469 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124584.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.124584.log.gz 2023-12-06T18:35:57.469 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129620.log 2023-12-06T18:35:57.469 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133517.log.gz 2023-12-06T18:35:57.469 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137861.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.125621.log -- replaced with /var/log/ceph/ceph-client.admin.137861.log.gz 2023-12-06T18:35:57.469 INFO:teuthology.orchestra.run.smithi123.stderr: 2023-12-06T18:35:57.469 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129620.log.gz 2023-12-06T18:35:57.470 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126210.log 2023-12-06T18:35:57.470 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126330.log 2023-12-06T18:35:57.470 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125621.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125621.log.gz 2023-12-06T18:35:57.470 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140914.log 2023-12-06T18:35:57.470 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126210.log.gz 2023-12-06T18:35:57.470 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153835.log 2023-12-06T18:35:57.470 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126330.log.gz 2023-12-06T18:35:57.470 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142542.log 2023-12-06T18:35:57.470 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140914.log.gz 2023-12-06T18:35:57.471 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153835.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.143329.log 2023-12-06T18:35:57.471 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.153835.log.gz 2023-12-06T18:35:57.471 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156595.log 2023-12-06T18:35:57.471 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142542.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142542.log.gz 2023-12-06T18:35:57.471 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.143329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150989.log 2023-12-06T18:35:57.471 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143329.log.gz 2023-12-06T18:35:57.471 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123432.log 2023-12-06T18:35:57.471 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156595.log.gz 2023-12-06T18:35:57.471 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132159.log 2023-12-06T18:35:57.471 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150989.log.gz 2023-12-06T18:35:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142606.log 2023-12-06T18:35:57.472 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123432.log.gz 2023-12-06T18:35:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133732.log 2023-12-06T18:35:57.472 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132159.log.gz 2023-12-06T18:35:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130071.log 2023-12-06T18:35:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142606.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142606.log.gz 2023-12-06T18:35:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161805.log 2023-12-06T18:35:57.472 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133732.log.gz 2023-12-06T18:35:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127210.log 2023-12-06T18:35:57.473 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130071.log.gz 2023-12-06T18:35:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151745.log 2023-12-06T18:35:57.473 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161805.log.gz 2023-12-06T18:35:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164851.log 2023-12-06T18:35:57.473 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127210.log.gz 2023-12-06T18:35:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125417.log 2023-12-06T18:35:57.473 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151745.log.gz 2023-12-06T18:35:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.164851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146978.log 2023-12-06T18:35:57.473 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164851.log.gz 2023-12-06T18:35:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125145.log 2023-12-06T18:35:57.474 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125417.log.gz 2023-12-06T18:35:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130260.log 2023-12-06T18:35:57.474 INFO:teuthology.orchestra.run.smithi123.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.146978.log.gz 2023-12-06T18:35:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121026.log 2023-12-06T18:35:57.474 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125145.log.gz 2023-12-06T18:35:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124034.log 2023-12-06T18:35:57.474 INFO:teuthology.orchestra.run.smithi123.stderr: 24.4% -- replaced with /var/log/ceph/ceph-client.admin.130260.log.gz 2023-12-06T18:35:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121026.log: gzip -5 --verbose 0.0%-- -- replaced with /var/log/ceph/ceph-client.admin.121026.log.gz/var/log/ceph/ceph-client.admin.136179.log 2023-12-06T18:35:57.474 INFO:teuthology.orchestra.run.smithi123.stderr: 2023-12-06T18:35:57.475 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156877.log 2023-12-06T18:35:57.475 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124034.log.gz 2023-12-06T18:35:57.475 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133801.log 2023-12-06T18:35:57.475 INFO:teuthology.orchestra.run.smithi123.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.136179.log.gz 2023-12-06T18:35:57.475 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121947.log 2023-12-06T18:35:57.475 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156877.log.gz 2023-12-06T18:35:57.475 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151498.log 2023-12-06T18:35:57.475 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133801.log.gz 2023-12-06T18:35:57.476 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152531.log 2023-12-06T18:35:57.476 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121947.log.gz 2023-12-06T18:35:57.476 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151498.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.154785.log 2023-12-06T18:35:57.476 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.151498.log.gz 2023-12-06T18:35:57.476 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121668.log 2023-12-06T18:35:57.476 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152531.log.gz 2023-12-06T18:35:57.476 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162653.log 2023-12-06T18:35:57.476 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154785.log.gz 2023-12-06T18:35:57.476 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147603.log 2023-12-06T18:35:57.477 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121668.log.gz 2023-12-06T18:35:57.477 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120467.log 2023-12-06T18:35:57.477 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162653.log.gz 2023-12-06T18:35:57.477 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154126.log 2023-12-06T18:35:57.477 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147603.log.gz 2023-12-06T18:35:57.477 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165186.log 2023-12-06T18:35:57.477 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120467.log.gz 2023-12-06T18:35:57.477 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126430.log 2023-12-06T18:35:57.477 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154126.log.gz 2023-12-06T18:35:57.477 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.165186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150285.log 2023-12-06T18:35:57.478 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165186.log.gz 2023-12-06T18:35:57.478 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126430.log.gz 2023-12-06T18:35:57.478 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133044.log 2023-12-06T18:35:57.478 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150285.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.150285.log.gz--verbose 2023-12-06T18:35:57.478 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.126150.log 2023-12-06T18:35:57.478 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147990.log 2023-12-06T18:35:57.478 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133044.log.gz 2023-12-06T18:35:57.478 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143114.log 2023-12-06T18:35:57.478 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126150.log.gz 2023-12-06T18:35:57.479 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164606.log 2023-12-06T18:35:57.479 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147990.log.gz 2023-12-06T18:35:57.479 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.143114.log: gzip -5 0.0%--verbose -- replaced with /var/log/ceph/ceph-client.admin.143114.log.gz-- 2023-12-06T18:35:57.479 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155971.log 2023-12-06T18:35:57.479 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.164606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149759.log 2023-12-06T18:35:57.479 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164606.log.gz 2023-12-06T18:35:57.479 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162899.log 2023-12-06T18:35:57.479 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155971.log.gz 2023-12-06T18:35:57.479 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155431.log 2023-12-06T18:35:57.480 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149759.log.gz 2023-12-06T18:35:57.480 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149797.log 2023-12-06T18:35:57.480 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162899.log.gz 2023-12-06T18:35:57.480 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119538.log 2023-12-06T18:35:57.480 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155431.log.gz 2023-12-06T18:35:57.480 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149797.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.159058.log -- replaced with /var/log/ceph/ceph-client.admin.149797.log.gz 2023-12-06T18:35:57.480 INFO:teuthology.orchestra.run.smithi123.stderr: 2023-12-06T18:35:57.480 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124873.log 2023-12-06T18:35:57.480 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119538.log.gz 2023-12-06T18:35:57.481 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154942.log 0.0% 2023-12-06T18:35:57.481 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.159058.log.gz 2023-12-06T18:35:57.481 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125332.log 2023-12-06T18:35:57.481 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124873.log.gz 2023-12-06T18:35:57.481 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152015.log 2023-12-06T18:35:57.481 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154942.log.gz 2023-12-06T18:35:57.481 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121968.log 2023-12-06T18:35:57.481 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125332.log.gz 2023-12-06T18:35:57.481 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152015.log.gz 2023-12-06T18:35:57.481 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145067.log 2023-12-06T18:35:57.482 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149779.log 2023-12-06T18:35:57.482 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121968.log.gz 2023-12-06T18:35:57.482 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145067.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145067.log.gz 2023-12-06T18:35:57.482 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129603.log 2023-12-06T18:35:57.482 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118526.log 2023-12-06T18:35:57.482 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149779.log.gz 2023-12-06T18:35:57.482 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129603.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.129603.log.gz-5 2023-12-06T18:35:57.482 INFO:teuthology.orchestra.run.smithi123.stderr:--verbose -- /var/log/ceph/ceph-client.admin.140308.log 2023-12-06T18:35:57.482 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.118526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156777.log 2023-12-06T18:35:57.483 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118526.log.gz 2023-12-06T18:35:57.483 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165398.log 2023-12-06T18:35:57.483 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140308.log.gz 2023-12-06T18:35:57.483 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125825.log 2023-12-06T18:35:57.483 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156777.log.gz 2023-12-06T18:35:57.483 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.165398.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165398.log.gz 2023-12-06T18:35:57.483 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135084.log 2023-12-06T18:35:57.483 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154725.log 2023-12-06T18:35:57.483 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125825.log.gz 2023-12-06T18:35:57.484 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129195.log 2023-12-06T18:35:57.484 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135084.log.gz 2023-12-06T18:35:57.484 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127090.log 2023-12-06T18:35:57.484 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154725.log.gz 2023-12-06T18:35:57.484 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118962.log 0.0% 2023-12-06T18:35:57.484 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.129195.log.gz 2023-12-06T18:35:57.484 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160694.log 2023-12-06T18:35:57.484 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127090.log.gz 2023-12-06T18:35:57.484 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.118962.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.160004.log 2023-12-06T18:35:57.485 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.118962.log.gz 2023-12-06T18:35:57.485 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126810.log 2023-12-06T18:35:57.485 INFO:teuthology.orchestra.run.smithi123.stderr: 11.1% -- replaced with /var/log/ceph/ceph-client.admin.160694.log.gz 2023-12-06T18:35:57.485 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160004.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.160004.log.gz--verbose 2023-12-06T18:35:57.485 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.165545.log 2023-12-06T18:35:57.485 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148119.log 2023-12-06T18:35:57.485 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126810.log.gz 2023-12-06T18:35:57.485 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.165545.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.165545.log.gz-5 2023-12-06T18:35:57.486 INFO:teuthology.orchestra.run.smithi123.stderr:--verbose -- /var/log/ceph/ceph-client.admin.152208.log 2023-12-06T18:35:57.486 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123905.log 2023-12-06T18:35:57.486 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148119.log.gz 2023-12-06T18:35:57.486 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152208.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152208.log.gz 2023-12-06T18:35:57.486 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120703.log 2023-12-06T18:35:57.486 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123905.log.gz 2023-12-06T18:35:57.486 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125774.log 2023-12-06T18:35:57.486 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120703.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.120703.log.gz 2023-12-06T18:35:57.486 INFO:teuthology.orchestra.run.smithi123.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.149959.log 2023-12-06T18:35:57.487 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151130.log 2023-12-06T18:35:57.487 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125774.log.gz 2023-12-06T18:35:57.487 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142504.log 2023-12-06T18:35:57.487 INFO:teuthology.orchestra.run.smithi123.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.149959.log.gz 2023-12-06T18:35:57.487 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142836.log 2023-12-06T18:35:57.487 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151130.log.gz 2023-12-06T18:35:57.487 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131879.log 2023-12-06T18:35:57.487 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142504.log.gz 2023-12-06T18:35:57.487 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160916.log 2023-12-06T18:35:57.488 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142836.log.gz 2023-12-06T18:35:57.488 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131879.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.131879.log.gz 2023-12-06T18:35:57.488 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127290.log 2023-12-06T18:35:57.488 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162632.log 2023-12-06T18:35:57.488 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160916.log.gz 2023-12-06T18:35:57.488 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127290.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.127290.log.gz-- 2023-12-06T18:35:57.488 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138988.log 2023-12-06T18:35:57.488 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134487.log 2023-12-06T18:35:57.488 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162632.log.gz 2023-12-06T18:35:57.489 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138076.log 2023-12-06T18:35:57.489 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138988.log.gz 2023-12-06T18:35:57.489 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127510.log 2023-12-06T18:35:57.489 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.134487.log.gz 2023-12-06T18:35:57.489 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138076.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138076.log.gz 2023-12-06T18:35:57.489 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157293.log 2023-12-06T18:35:57.489 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138508.log 2023-12-06T18:35:57.489 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127510.log.gz 2023-12-06T18:35:57.489 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157293.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157293.log.gz 2023-12-06T18:35:57.490 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133835.log 2023-12-06T18:35:57.490 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130134.log 2023-12-06T18:35:57.490 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138508.log.gz 2023-12-06T18:35:57.490 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133835.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.133835.log.gz 2023-12-06T18:35:57.490 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158631.log 2023-12-06T18:35:57.490 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150543.log 2023-12-06T18:35:57.490 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130134.log.gz 2023-12-06T18:35:57.490 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125281.log 2023-12-06T18:35:57.490 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158631.log.gz 2023-12-06T18:35:57.491 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138162.log 2023-12-06T18:35:57.491 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150543.log.gz 2023-12-06T18:35:57.491 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125196.log 2023-12-06T18:35:57.491 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125281.log.gz 2023-12-06T18:35:57.491 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126850.log 2023-12-06T18:35:57.491 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138162.log.gz 2023-12-06T18:35:57.491 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121271.log 2023-12-06T18:35:57.491 INFO:teuthology.orchestra.run.smithi123.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.125196.log.gz 2023-12-06T18:35:57.491 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126850.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126850.log.gz 2023-12-06T18:35:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125655.log 2023-12-06T18:35:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148474.log 2023-12-06T18:35:57.492 INFO:teuthology.orchestra.run.smithi123.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.121271.log.gz 2023-12-06T18:35:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153564.log 2023-12-06T18:35:57.492 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125655.log.gz 2023-12-06T18:35:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165643.log 2023-12-06T18:35:57.492 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148474.log.gz 2023-12-06T18:35:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165937.log 2023-12-06T18:35:57.492 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153564.log.gz 2023-12-06T18:35:57.493 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130974.log 2023-12-06T18:35:57.493 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.165643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165643.log.gz 2023-12-06T18:35:57.493 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.165937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165937.log.gz 2023-12-06T18:35:57.493 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122893.log 2023-12-06T18:35:57.493 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130974.log: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.130974.log.gz 2023-12-06T18:35:57.493 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148725.log 2023-12-06T18:35:57.493 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136955.log 2023-12-06T18:35:57.493 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122893.log.gz 2023-12-06T18:35:57.493 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144873.log 2023-12-06T18:35:57.493 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148725.log.gz 2023-12-06T18:35:57.494 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151950.log 2023-12-06T18:35:57.494 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136955.log.gz 2023-12-06T18:35:57.494 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.144873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139887.log 2023-12-06T18:35:57.494 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144873.log.gz 2023-12-06T18:35:57.494 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151950.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.151950.log.gz-- 2023-12-06T18:35:57.494 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136976.log 2023-12-06T18:35:57.494 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121254.log 2023-12-06T18:35:57.494 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139887.log.gz 2023-12-06T18:35:57.494 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136783.log 2023-12-06T18:35:57.495 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136976.log.gz 2023-12-06T18:35:57.495 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161033.log 2023-12-06T18:35:57.495 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121254.log.gz 2023-12-06T18:35:57.495 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132958.log 2023-12-06T18:35:57.495 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136783.log.gz 2023-12-06T18:35:57.495 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123798.log 2023-12-06T18:35:57.495 INFO:teuthology.orchestra.run.smithi123.stderr: 54.2% -- replaced with /var/log/ceph/ceph-client.admin.161033.log.gz 2023-12-06T18:35:57.495 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132958.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.150565.log -- replaced with /var/log/ceph/ceph-client.admin.132958.log.gz 2023-12-06T18:35:57.496 INFO:teuthology.orchestra.run.smithi123.stderr: 2023-12-06T18:35:57.496 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151662.log 2023-12-06T18:35:57.496 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123798.log.gz 2023-12-06T18:35:57.496 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150565.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.150565.log.gz--verbose 2023-12-06T18:35:57.496 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.139181.log 2023-12-06T18:35:57.496 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126710.log 2023-12-06T18:35:57.496 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151662.log.gz 2023-12-06T18:35:57.496 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140511.log 2023-12-06T18:35:57.496 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139181.log.gz 2023-12-06T18:35:57.497 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153852.log 2023-12-06T18:35:57.497 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126710.log.gz 2023-12-06T18:35:57.497 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140511.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.140511.log.gz--verbose 2023-12-06T18:35:57.497 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.147387.log 2023-12-06T18:35:57.497 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147301.log 2023-12-06T18:35:57.497 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153852.log.gz 2023-12-06T18:35:57.497 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147387.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147387.log.gzgzip 2023-12-06T18:35:57.497 INFO:teuthology.orchestra.run.smithi123.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.118832.log 2023-12-06T18:35:57.497 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145561.log 2023-12-06T18:35:57.498 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147301.log.gz 2023-12-06T18:35:57.498 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.118832.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.136142.log -- replaced with /var/log/ceph/ceph-client.admin.118832.log.gz 2023-12-06T18:35:57.498 INFO:teuthology.orchestra.run.smithi123.stderr: 2023-12-06T18:35:57.498 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145561.log.gz 2023-12-06T18:35:57.498 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162159.log 2023-12-06T18:35:57.498 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136404.log 2023-12-06T18:35:57.498 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136142.log.gz 2023-12-06T18:35:57.498 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155067.log 2023-12-06T18:35:57.499 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162159.log.gz 2023-12-06T18:35:57.499 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152703.log 2023-12-06T18:35:57.499 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136404.log.gz 2023-12-06T18:35:57.499 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148515.log 2023-12-06T18:35:57.499 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155067.log.gz 2023-12-06T18:35:57.499 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152703.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.162011.log 2023-12-06T18:35:57.499 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.152703.log.gz 2023-12-06T18:35:57.499 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129518.log 2023-12-06T18:35:57.499 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148515.log.gz 2023-12-06T18:35:57.500 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162011.log.gz 2023-12-06T18:35:57.500 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152144.log 2023-12-06T18:35:57.500 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121711.log 2023-12-06T18:35:57.500 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129518.log.gz 2023-12-06T18:35:57.500 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152144.log: gzip -5 --verbose 0.0%-- -- replaced with /var/log/ceph/ceph-client.admin.152144.log.gz/var/log/ceph/ceph-client.admin.148247.log 2023-12-06T18:35:57.500 INFO:teuthology.orchestra.run.smithi123.stderr: 2023-12-06T18:35:57.500 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161697.log 2023-12-06T18:35:57.500 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121711.log.gz 2023-12-06T18:35:57.500 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148247.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.143265.log -- replaced with /var/log/ceph/ceph-client.admin.148247.log.gz 2023-12-06T18:35:57.501 INFO:teuthology.orchestra.run.smithi123.stderr: 2023-12-06T18:35:57.501 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123301.log 2023-12-06T18:35:57.501 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161697.log.gz 2023-12-06T18:35:57.501 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.143265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149719.log 0.0% 2023-12-06T18:35:57.501 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.143265.log.gz 2023-12-06T18:35:57.501 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123884.log 2023-12-06T18:35:57.501 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123301.log.gz 2023-12-06T18:35:57.501 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132417.log 2023-12-06T18:35:57.501 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149719.log.gz 2023-12-06T18:35:57.502 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131394.log 2023-12-06T18:35:57.502 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123884.log.gz 2023-12-06T18:35:57.502 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136421.log 2023-12-06T18:35:57.502 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132417.log.gz 2023-12-06T18:35:57.502 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155933.log 2023-12-06T18:35:57.502 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131394.log.gz 2023-12-06T18:35:57.502 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127930.log 2023-12-06T18:35:57.502 INFO:teuthology.orchestra.run.smithi123.stderr: 31.8% -- replaced with /var/log/ceph/ceph-client.admin.136421.log.gz 2023-12-06T18:35:57.502 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147560.log 2023-12-06T18:35:57.503 INFO:teuthology.orchestra.run.smithi123.stderr: 24.9% -- replaced with /var/log/ceph/ceph-client.admin.155933.log.gz 2023-12-06T18:35:57.503 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127930.log.gz 2023-12-06T18:35:57.503 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132760.log 2023-12-06T18:35:57.503 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128345.log 2023-12-06T18:35:57.503 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147560.log.gz 2023-12-06T18:35:57.503 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152724.log 2023-12-06T18:35:57.503 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132760.log.gz 2023-12-06T18:35:57.503 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150178.log 2023-12-06T18:35:57.503 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128345.log.gz 2023-12-06T18:35:57.503 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141686.log 2023-12-06T18:35:57.504 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152724.log.gz 2023-12-06T18:35:57.504 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119983.log 2023-12-06T18:35:57.504 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150178.log.gz 2023-12-06T18:35:57.504 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149557.log 2023-12-06T18:35:57.504 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141686.log.gz 2023-12-06T18:35:57.504 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162180.log 2023-12-06T18:35:57.504 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119983.log.gz 2023-12-06T18:35:57.504 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149557.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.149557.log.gz 2023-12-06T18:35:57.504 INFO:teuthology.orchestra.run.smithi123.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.145708.log 2023-12-06T18:35:57.505 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162180.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162180.log.gz 2023-12-06T18:35:57.505 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139740.log 2023-12-06T18:35:57.505 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145708.log.gz 2023-12-06T18:35:57.505 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121819.log 2023-12-06T18:35:57.505 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139740.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-06T18:35:57.505 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139740.log.gz 2023-12-06T18:35:57.505 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118014.log 2023-12-06T18:35:57.505 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121819.log.gz 2023-12-06T18:35:57.505 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121475.log 2023-12-06T18:35:57.506 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.118014.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118014.log.gzgzip 2023-12-06T18:35:57.506 INFO:teuthology.orchestra.run.smithi123.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.126590.log 2023-12-06T18:35:57.506 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145811.log 2023-12-06T18:35:57.506 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121475.log.gz 2023-12-06T18:35:57.506 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-06T18:35:57.506 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126590.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126590.log.gz 2023-12-06T18:35:57.506 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165136.log 2023-12-06T18:35:57.506 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145811.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.145811.log.gz/var/log/ceph/ceph-client.admin.157312.log 2023-12-06T18:35:57.506 INFO:teuthology.orchestra.run.smithi123.stderr: 2023-12-06T18:35:57.507 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.165136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119026.log 2023-12-06T18:35:57.507 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165136.log.gz 2023-12-06T18:35:57.507 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135524.log 2023-12-06T18:35:57.507 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157312.log.gz 2023-12-06T18:35:57.507 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146032.log 2023-12-06T18:35:57.507 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119026.log.gz 2023-12-06T18:35:57.507 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160976.log 2023-12-06T18:35:57.507 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135524.log.gz 2023-12-06T18:35:57.507 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126730.log 2023-12-06T18:35:57.508 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146032.log.gz 2023-12-06T18:35:57.508 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151622.log 2023-12-06T18:35:57.508 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160976.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160976.log.gz 2023-12-06T18:35:57.508 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143630.log 2023-12-06T18:35:57.508 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126730.log.gz 2023-12-06T18:35:57.508 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146448.log 2023-12-06T18:35:57.508 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151622.log.gz 2023-12-06T18:35:57.508 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.143630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126790.log 2023-12-06T18:35:57.508 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143630.log.gz 2023-12-06T18:35:57.509 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137732.log 2023-12-06T18:35:57.509 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146448.log.gz 2023-12-06T18:35:57.509 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161375.log 2023-12-06T18:35:57.509 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126790.log.gz 2023-12-06T18:35:57.509 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150849.log 2023-12-06T18:35:57.509 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137732.log.gz 2023-12-06T18:35:57.509 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119284.log 2023-12-06T18:35:57.509 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161375.log.gz 2023-12-06T18:35:57.509 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154765.log 2023-12-06T18:35:57.510 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150849.log.gz 2023-12-06T18:35:57.510 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136583.log 2023-12-06T18:35:57.510 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119284.log.gz 2023-12-06T18:35:57.510 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119679.log 2023-12-06T18:35:57.510 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154765.log.gz 2023-12-06T18:35:57.510 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165888.log 2023-12-06T18:35:57.510 INFO:teuthology.orchestra.run.smithi123.stderr: 24.3% -- replaced with /var/log/ceph/ceph-client.admin.136583.log.gz 2023-12-06T18:35:57.510 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119679.log.gz 2023-12-06T18:35:57.510 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158717.log 2023-12-06T18:35:57.511 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.165888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134645.log 2023-12-06T18:35:57.511 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165888.log.gz 2023-12-06T18:35:57.511 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161987.log 2023-12-06T18:35:57.511 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158717.log.gz 2023-12-06T18:35:57.511 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134645.log: 59.3% -- replaced with /var/log/ceph/ceph-client.admin.134645.log.gz 2023-12-06T18:35:57.511 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140980.log 2023-12-06T18:35:57.511 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147172.log 2023-12-06T18:35:57.511 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161987.log.gz 2023-12-06T18:35:57.511 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122183.log 2023-12-06T18:35:57.512 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140980.log.gz 2023-12-06T18:35:57.512 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145588.log 2023-12-06T18:35:57.512 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147172.log.gz 2023-12-06T18:35:57.512 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122183.log.gz 2023-12-06T18:35:57.512 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136826.log 2023-12-06T18:35:57.512 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137754.log 2023-12-06T18:35:57.512 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145588.log.gz 2023-12-06T18:35:57.512 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132223.log 2023-12-06T18:35:57.512 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136826.log.gz 2023-12-06T18:35:57.513 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137754.log: gzip -5 --verbose 0.0%-- -- replaced with /var/log/ceph/ceph-client.admin.137754.log.gz/var/log/ceph/ceph-client.admin.127070.log 2023-12-06T18:35:57.513 INFO:teuthology.orchestra.run.smithi123.stderr: 2023-12-06T18:35:57.513 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132223.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.132223.log.gz--verbose 2023-12-06T18:35:57.513 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.120153.log 2023-12-06T18:35:57.513 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149177.log 2023-12-06T18:35:57.513 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127070.log.gz 2023-12-06T18:35:57.513 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122054.log 0.0% 2023-12-06T18:35:57.513 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.120153.log.gz 2023-12-06T18:35:57.513 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133194.log 2023-12-06T18:35:57.514 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149177.log.gz 2023-12-06T18:35:57.514 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147882.log 2023-12-06T18:35:57.514 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122054.log.gz 2023-12-06T18:35:57.514 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126110.log 2023-12-06T18:35:57.514 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133194.log.gz 2023-12-06T18:35:57.514 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147882.log.gz 2023-12-06T18:35:57.514 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157584.log 2023-12-06T18:35:57.514 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145728.log 2023-12-06T18:35:57.514 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126110.log.gz 2023-12-06T18:35:57.515 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157584.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157584.log.gz 2023-12-06T18:35:57.515 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136122.log 2023-12-06T18:35:57.515 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143286.log 2023-12-06T18:35:57.515 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145728.log.gz 2023-12-06T18:35:57.515 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148558.log 0.0% 2023-12-06T18:35:57.515 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.136122.log.gz 2023-12-06T18:35:57.515 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.143286.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.128379.log -- replaced with /var/log/ceph/ceph-client.admin.143286.log.gz 2023-12-06T18:35:57.515 INFO:teuthology.orchestra.run.smithi123.stderr: 2023-12-06T18:35:57.515 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148558.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148558.log.gz 2023-12-06T18:35:57.516 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124550.log 2023-12-06T18:35:57.516 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128379.log.gz 2023-12-06T18:35:57.516 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141299.log 2023-12-06T18:35:57.516 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138119.log 2023-12-06T18:35:57.516 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124550.log.gz 2023-12-06T18:35:57.516 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131163.log 2023-12-06T18:35:57.516 INFO:teuthology.orchestra.run.smithi123.stderr: 22.8% -- replaced with /var/log/ceph/ceph-client.admin.141299.log.gz 2023-12-06T18:35:57.516 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151582.log 2023-12-06T18:35:57.516 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138119.log.gz 2023-12-06T18:35:57.517 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156442.log 0.0% 2023-12-06T18:35:57.517 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.131163.log.gz 2023-12-06T18:35:57.517 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132799.log 2023-12-06T18:35:57.517 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151582.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151582.log.gz 2023-12-06T18:35:57.517 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128107.log 2023-12-06T18:35:57.517 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156442.log.gz 2023-12-06T18:35:57.517 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160896.log 2023-12-06T18:35:57.517 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132799.log.gz 2023-12-06T18:35:57.517 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128107.log.gz 2023-12-06T18:35:57.517 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146095.log 2023-12-06T18:35:57.518 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149048.log 2023-12-06T18:35:57.518 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160896.log.gz 2023-12-06T18:35:57.518 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146095.log.gz 2023-12-06T18:35:57.518 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158571.log 2023-12-06T18:35:57.518 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140446.log 2023-12-06T18:35:57.518 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149048.log.gz 2023-12-06T18:35:57.518 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153716.log 2023-12-06T18:35:57.518 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158571.log.gz 2023-12-06T18:35:57.519 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142964.log 2023-12-06T18:35:57.519 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140446.log.gz 2023-12-06T18:35:57.519 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153716.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.153716.log.gz--verbose 2023-12-06T18:35:57.519 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.161719.log 2023-12-06T18:35:57.519 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161952.log 2023-12-06T18:35:57.519 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142964.log.gz 2023-12-06T18:35:57.519 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161719.log.gz 2023-12-06T18:35:57.519 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128124.log 2023-12-06T18:35:57.519 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120553.log 2023-12-06T18:35:57.519 INFO:teuthology.orchestra.run.smithi123.stderr: 54.4% -- replaced with /var/log/ceph/ceph-client.admin.161952.log.gz 2023-12-06T18:35:57.520 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161439.log 2023-12-06T18:35:57.520 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128124.log.gz 2023-12-06T18:35:57.520 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156760.log 2023-12-06T18:35:57.520 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120553.log.gz 2023-12-06T18:35:57.520 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142225.log 2023-12-06T18:35:57.520 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161439.log.gz 2023-12-06T18:35:57.520 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153348.log 2023-12-06T18:35:57.520 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156760.log.gz 2023-12-06T18:35:57.520 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123088.log 2023-12-06T18:35:57.521 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142225.log.gz 2023-12-06T18:35:57.521 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160443.log 2023-12-06T18:35:57.521 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153348.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153348.log.gz 2023-12-06T18:35:57.521 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130596.log 2023-12-06T18:35:57.521 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123088.log.gz 2023-12-06T18:35:57.521 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160443.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160443.log.gz 2023-12-06T18:35:57.521 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155717.log 2023-12-06T18:35:57.521 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133919.log 2023-12-06T18:35:57.521 INFO:teuthology.orchestra.run.smithi123.stderr: 24.4% -- replaced with /var/log/ceph/ceph-client.admin.130596.log.gz 2023-12-06T18:35:57.522 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155717.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155717.log.gz 2023-12-06T18:35:57.522 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128770.log 2023-12-06T18:35:57.522 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147408.log 2023-12-06T18:35:57.522 INFO:teuthology.orchestra.run.smithi123.stderr: 17.2% -- replaced with /var/log/ceph/ceph-client.admin.133919.log.gz 2023-12-06T18:35:57.522 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126270.log 2023-12-06T18:35:57.522 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128770.log.gz 2023-12-06T18:35:57.522 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126130.log 2023-12-06T18:35:57.522 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147408.log.gz 2023-12-06T18:35:57.522 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126270.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.122312.log -- replaced with /var/log/ceph/ceph-client.admin.126270.log.gz 2023-12-06T18:35:57.523 INFO:teuthology.orchestra.run.smithi123.stderr: 2023-12-06T18:35:57.523 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140531.log 2023-12-06T18:35:57.523 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126130.log.gz 2023-12-06T18:35:57.523 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161160.log 2023-12-06T18:35:57.523 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122312.log.gz 2023-12-06T18:35:57.523 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151561.log 2023-12-06T18:35:57.523 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140531.log.gz 2023-12-06T18:35:57.523 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138833.log 2023-12-06T18:35:57.523 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161160.log.gz 2023-12-06T18:35:57.524 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138718.log 2023-12-06T18:35:57.524 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151561.log.gz 2023-12-06T18:35:57.524 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140028.log 2023-12-06T18:35:57.524 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138833.log.gz 2023-12-06T18:35:57.524 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154029.log 2023-12-06T18:35:57.524 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138718.log.gz 2023-12-06T18:35:57.524 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156998.log 2023-12-06T18:35:57.524 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140028.log.gz 2023-12-06T18:35:57.524 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150070.log 2023-12-06T18:35:57.524 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154029.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154029.log.gz 2023-12-06T18:35:57.525 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142440.log 2023-12-06T18:35:57.525 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156998.log.gz 2023-12-06T18:35:57.525 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150070.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150070.log.gz 2023-12-06T18:35:57.525 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127490.log 2023-12-06T18:35:57.525 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154882.log 2023-12-06T18:35:57.525 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142440.log.gz 2023-12-06T18:35:57.525 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127490.log: gzip -5 0.0%--verbose -- replaced with /var/log/ceph/ceph-client.admin.127490.log.gz-- 2023-12-06T18:35:57.525 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128073.log 2023-12-06T18:35:57.526 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147839.log 2023-12-06T18:35:57.526 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154882.log.gz 2023-12-06T18:35:57.526 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128073.log: gzip -5 --verbose 0.0%-- -- replaced with /var/log/ceph/ceph-client.admin.128073.log.gz/var/log/ceph/ceph-client.admin.151007.log 2023-12-06T18:35:57.526 INFO:teuthology.orchestra.run.smithi123.stderr: 2023-12-06T18:35:57.526 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147839.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.147839.log.gz--verbose 2023-12-06T18:35:57.526 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.162395.log 2023-12-06T18:35:57.526 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151007.log.gz 2023-12-06T18:35:57.526 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120617.log 2023-12-06T18:35:57.526 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162395.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162395.log.gz 2023-12-06T18:35:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124618.log 2023-12-06T18:35:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120617.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.120617.log.gz--verbose 2023-12-06T18:35:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.135105.log 2023-12-06T18:35:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146914.log 2023-12-06T18:35:57.527 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124618.log.gz 2023-12-06T18:35:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118112.log 2023-12-06T18:35:57.527 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135105.log.gz 2023-12-06T18:35:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146914.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.141773.log -- replaced with /var/log/ceph/ceph-client.admin.146914.log.gz 2023-12-06T18:35:57.527 INFO:teuthology.orchestra.run.smithi123.stderr: 2023-12-06T18:35:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.118112.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118112.log.gz 2023-12-06T18:35:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128600.log 2023-12-06T18:35:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146609.log 0.0% 2023-12-06T18:35:57.528 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.141773.log.gz 2023-12-06T18:35:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117424.log 2023-12-06T18:35:57.528 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128600.log.gz 2023-12-06T18:35:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124958.log 2023-12-06T18:35:57.528 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146609.log.gz 2023-12-06T18:35:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.117424.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.155354.log 2023-12-06T18:35:57.528 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.117424.log.gz 2023-12-06T18:35:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124839.log 2023-12-06T18:35:57.529 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124958.log.gz 2023-12-06T18:35:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155354.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.155354.log.gz-5 2023-12-06T18:35:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:--verbose -- /var/log/ceph/ceph-client.admin.127110.log 2023-12-06T18:35:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138270.log 2023-12-06T18:35:57.529 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124839.log.gz 2023-12-06T18:35:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127110.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.127110.log.gz 2023-12-06T18:35:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.149858.log 2023-12-06T18:35:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135002.log 2023-12-06T18:35:57.530 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138270.log.gz 2023-12-06T18:35:57.530 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149858.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.149858.log.gz--verbose 2023-12-06T18:35:57.530 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.129314.log 2023-12-06T18:35:57.530 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155513.log 2023-12-06T18:35:57.530 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135002.log.gz 2023-12-06T18:35:57.530 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129314.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.146569.log 2023-12-06T18:35:57.530 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.129314.log.gz 2023-12-06T18:35:57.530 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128192.log 2023-12-06T18:35:57.530 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155513.log.gz 2023-12-06T18:35:57.531 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146569.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.146569.log.gz--verbose 2023-12-06T18:35:57.531 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.138184.log 2023-12-06T18:35:57.531 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128192.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.149659.log -- replaced with /var/log/ceph/ceph-client.admin.128192.log.gz 2023-12-06T18:35:57.531 INFO:teuthology.orchestra.run.smithi123.stderr: 2023-12-06T18:35:57.531 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125383.log 2023-12-06T18:35:57.531 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138184.log.gz 2023-12-06T18:35:57.531 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149659.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149659.log.gz 2023-12-06T18:35:57.531 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142461.log 2023-12-06T18:35:57.531 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125383.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.125383.log.gz 2023-12-06T18:35:57.532 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147474.log 2023-12-06T18:35:57.532 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127710.log 2023-12-06T18:35:57.532 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142461.log.gz 2023-12-06T18:35:57.532 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148790.log 2023-12-06T18:35:57.532 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147474.log.gz 2023-12-06T18:35:57.532 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127710.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.137084.log 2023-12-06T18:35:57.532 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.127710.log.gz 2023-12-06T18:35:57.532 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157778.log 2023-12-06T18:35:57.532 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148790.log.gz 2023-12-06T18:35:57.533 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122527.log 2023-12-06T18:35:57.533 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137084.log.gz 2023-12-06T18:35:57.533 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157778.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.153988.log -- replaced with /var/log/ceph/ceph-client.admin.157778.log.gz 2023-12-06T18:35:57.533 INFO:teuthology.orchestra.run.smithi123.stderr: 2023-12-06T18:35:57.533 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132352.log 2023-12-06T18:35:57.533 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122527.log.gz 2023-12-06T18:35:57.533 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156720.log 2023-12-06T18:35:57.533 INFO:teuthology.orchestra.run.smithi123.stderr: 51.6% -- replaced with /var/log/ceph/ceph-client.admin.153988.log.gz 2023-12-06T18:35:57.533 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132352.log.gz 2023-12-06T18:35:57.533 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153699.log 2023-12-06T18:35:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148538.log 2023-12-06T18:35:57.534 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156720.log.gz 2023-12-06T18:35:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153699.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153699.log.gz 2023-12-06T18:35:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144852.log 2023-12-06T18:35:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147107.log 2023-12-06T18:35:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148538.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148538.log.gz 2023-12-06T18:35:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.144852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135042.log 2023-12-06T18:35:57.534 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144852.log.gz 2023-12-06T18:35:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147365.log 2023-12-06T18:35:57.535 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147107.log.gz 2023-12-06T18:35:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135042.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.135042.log.gz--verbose 2023-12-06T18:35:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.135229.log 2023-12-06T18:35:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154963.log 2023-12-06T18:35:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147365.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147365.log.gz 2023-12-06T18:35:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148205.log 2023-12-06T18:35:57.535 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135229.log.gz 2023-12-06T18:35:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135145.log 2023-12-06T18:35:57.535 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154963.log.gz 2023-12-06T18:35:57.536 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151768.log 2023-12-06T18:35:57.536 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148205.log.gz 2023-12-06T18:35:57.536 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140874.log 2023-12-06T18:35:57.536 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135145.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135145.log.gz 2023-12-06T18:35:57.536 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147322.log 2023-12-06T18:35:57.536 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151768.log.gz 2023-12-06T18:35:57.536 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152875.log 2023-12-06T18:35:57.536 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140874.log.gz 2023-12-06T18:35:57.536 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147322.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147322.log.gz 2023-12-06T18:35:57.537 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152230.log 2023-12-06T18:35:57.537 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137492.log 2023-12-06T18:35:57.537 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152875.log.gz 2023-12-06T18:35:57.537 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150715.log 2023-12-06T18:35:57.537 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152230.log.gz 2023-12-06T18:35:57.537 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137492.log.gz 2023-12-06T18:35:57.537 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157993.log 2023-12-06T18:35:57.537 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161246.log 2023-12-06T18:35:57.537 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150715.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150715.log.gz 2023-12-06T18:35:57.538 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128311.log 2023-12-06T18:35:57.538 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157993.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157993.log.gz 2023-12-06T18:35:57.538 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138455.log 2023-12-06T18:35:57.538 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161246.log.gz 2023-12-06T18:35:57.538 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128311.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.128311.log.gz-5 2023-12-06T18:35:57.538 INFO:teuthology.orchestra.run.smithi123.stderr:--verbose -- /var/log/ceph/ceph-client.admin.117718.log 2023-12-06T18:35:57.538 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154398.log 2023-12-06T18:35:57.538 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138455.log.gz 2023-12-06T18:35:57.538 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.117718.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117718.log.gz 2023-12-06T18:35:57.539 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128872.log 2023-12-06T18:35:57.539 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123647.log 2023-12-06T18:35:57.539 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154398.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154398.log.gz 2023-12-06T18:35:57.539 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159746.log 2023-12-06T18:35:57.539 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128872.log.gz 2023-12-06T18:35:57.539 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133216.log 2023-12-06T18:35:57.539 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123647.log.gz 2023-12-06T18:35:57.539 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159746.log.gz 2023-12-06T18:35:57.539 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130785.log 2023-12-06T18:35:57.540 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142397.log 2023-12-06T18:35:57.540 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133216.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133216.log.gz 2023-12-06T18:35:57.540 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144724.log 2023-12-06T18:35:57.540 INFO:teuthology.orchestra.run.smithi123.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.130785.log.gz 2023-12-06T18:35:57.540 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132918.log 2023-12-06T18:35:57.540 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142397.log.gz 2023-12-06T18:35:57.540 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.144724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155776.log 2023-12-06T18:35:57.540 INFO:teuthology.orchestra.run.smithi123.stderr: 54.7% -- replaced with /var/log/ceph/ceph-client.admin.144724.log.gz 2023-12-06T18:35:57.540 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124533.log 2023-12-06T18:35:57.541 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132918.log.gz 2023-12-06T18:35:57.541 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147064.log 2023-12-06T18:35:57.541 INFO:teuthology.orchestra.run.smithi123.stderr: 52.9% -- replaced with /var/log/ceph/ceph-client.admin.155776.log.gz 2023-12-06T18:35:57.541 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156405.log 2023-12-06T18:35:57.541 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124533.log.gz 2023-12-06T18:35:57.541 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126650.log 23.3% 2023-12-06T18:35:57.541 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.147064.log.gz 2023-12-06T18:35:57.541 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150113.log 2023-12-06T18:35:57.541 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156405.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156405.log.gz 2023-12-06T18:35:57.542 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149456.log 2023-12-06T18:35:57.542 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126650.log.gz 2023-12-06T18:35:57.542 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160403.log 2023-12-06T18:35:57.542 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150113.log.gz 2023-12-06T18:35:57.542 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134795.log 2023-12-06T18:35:57.542 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149456.log.gz 2023-12-06T18:35:57.542 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144357.log 2023-12-06T18:35:57.542 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160403.log.gz 2023-12-06T18:35:57.542 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152380.log 2023-12-06T18:35:57.543 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134795.log.gz 2023-12-06T18:35:57.543 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.144357.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144357.log.gz 2023-12-06T18:35:57.543 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159617.log 2023-12-06T18:35:57.543 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128430.log 2023-12-06T18:35:57.543 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152380.log.gz 2023-12-06T18:35:57.543 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118810.log 2023-12-06T18:35:57.543 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159617.log.gz 2023-12-06T18:35:57.543 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165790.log 2023-12-06T18:35:57.543 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128430.log.gz 2023-12-06T18:35:57.543 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.118810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118810.log.gz 2023-12-06T18:35:57.544 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157928.log 2023-12-06T18:35:57.544 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127330.log 2023-12-06T18:35:57.544 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.165790.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165790.log.gz 2023-12-06T18:35:57.544 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156066.log 2023-12-06T18:35:57.544 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157928.log.gz 2023-12-06T18:35:57.544 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120133.log 2023-12-06T18:35:57.544 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127330.log.gz 2023-12-06T18:35:57.544 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156066.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156066.log.gz 2023-12-06T18:35:57.544 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161762.log 2023-12-06T18:35:57.545 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123561.log 2023-12-06T18:35:57.545 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120133.log.gz 2023-12-06T18:35:57.545 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161762.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161762.log.gz 2023-12-06T18:35:57.545 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114438.log 2023-12-06T18:35:57.545 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122850.log 2023-12-06T18:35:57.545 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123561.log.gz 2023-12-06T18:35:57.545 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.114438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123012.log 2023-12-06T18:35:57.545 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114438.log.gz 2023-12-06T18:35:57.545 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132836.log 2023-12-06T18:35:57.546 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122850.log.gz 2023-12-06T18:35:57.546 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123012.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123012.log.gz 2023-12-06T18:35:57.546 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131772.log 2023-12-06T18:35:57.546 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124244.log 2023-12-06T18:35:57.546 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132836.log.gz 2023-12-06T18:35:57.546 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131772.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.131772.log.gz--verbose 2023-12-06T18:35:57.546 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.161418.log 2023-12-06T18:35:57.546 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120725.log 2023-12-06T18:35:57.546 INFO:teuthology.orchestra.run.smithi123.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.124244.log.gz 2023-12-06T18:35:57.547 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153816.log 2023-12-06T18:35:57.547 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161418.log.gz 2023-12-06T18:35:57.547 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138854.log 2023-12-06T18:35:57.547 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120725.log.gz 2023-12-06T18:35:57.547 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153816.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153816.log.gz 2023-12-06T18:35:57.547 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144768.log 2023-12-06T18:35:57.547 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135960.log 2023-12-06T18:35:57.547 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138854.log.gz 2023-12-06T18:35:57.547 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.144768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127430.log 2023-12-06T18:35:57.548 INFO:teuthology.orchestra.run.smithi123.stderr: 52.6% -- replaced with /var/log/ceph/ceph-client.admin.144768.log.gz 2023-12-06T18:35:57.548 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123322.log 2023-12-06T18:35:57.548 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135960.log.gz 2023-12-06T18:35:57.548 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127430.log.gz 2023-12-06T18:35:57.548 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130890.log 2023-12-06T18:35:57.548 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161015.log 2023-12-06T18:35:57.548 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123322.log.gz 2023-12-06T18:35:57.548 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126530.log 2023-12-06T18:35:57.548 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130890.log.gz 2023-12-06T18:35:57.549 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158281.log 2023-12-06T18:35:57.549 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161015.log.gz 2023-12-06T18:35:57.549 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155394.log 2023-12-06T18:35:57.549 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126530.log.gz 2023-12-06T18:35:57.549 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131058.log 2023-12-06T18:35:57.549 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158281.log.gz 2023-12-06T18:35:57.549 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125970.log 2023-12-06T18:35:57.549 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155394.log.gz 2023-12-06T18:35:57.549 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161054.log 2023-12-06T18:35:57.550 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131058.log.gz 2023-12-06T18:35:57.550 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125970.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125970.log.gz 2023-12-06T18:35:57.550 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122570.log 2023-12-06T18:35:57.550 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146366.log 2023-12-06T18:35:57.550 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161054.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161054.log.gz 2023-12-06T18:35:57.550 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139289.log 2023-12-06T18:35:57.550 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122570.log.gz 2023-12-06T18:35:57.550 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127130.log 2023-12-06T18:35:57.550 INFO:teuthology.orchestra.run.smithi123.stderr: 26.9% -- replaced with /var/log/ceph/ceph-client.admin.146366.log.gz 2023-12-06T18:35:57.551 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156817.log 2023-12-06T18:35:57.551 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139289.log.gz 2023-12-06T18:35:57.551 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135564.log 2023-12-06T18:35:57.551 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127130.log.gz 2023-12-06T18:35:57.551 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159123.log 2023-12-06T18:35:57.551 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156817.log.gz 2023-12-06T18:35:57.551 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143437.log 2023-12-06T18:35:57.551 INFO:teuthology.orchestra.run.smithi123.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.135564.log.gz 2023-12-06T18:35:57.551 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159123.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.159123.log.gz 2023-12-06T18:35:57.552 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148264.log 2023-12-06T18:35:57.552 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.143437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124205.log 2023-12-06T18:35:57.552 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143437.log.gz 2023-12-06T18:35:57.552 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148264.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.148264.log.gz--verbose 2023-12-06T18:35:57.552 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.125434.log 2023-12-06T18:35:57.552 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128396.log 2023-12-06T18:35:57.552 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124205.log.gz 2023-12-06T18:35:57.552 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139224.log 2023-12-06T18:35:57.552 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125434.log.gz 2023-12-06T18:35:57.553 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140655.log 2023-12-06T18:35:57.553 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128396.log.gz 2023-12-06T18:35:57.553 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139224.log.gz 2023-12-06T18:35:57.553 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129861.log 2023-12-06T18:35:57.553 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158591.log 2023-12-06T18:35:57.553 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140655.log.gz 2023-12-06T18:35:57.553 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129861.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129861.log.gz 2023-12-06T18:35:57.553 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126550.log 2023-12-06T18:35:57.553 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133624.log 2023-12-06T18:35:57.553 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158591.log.gz 2023-12-06T18:35:57.554 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126550.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126550.log.gz 2023-12-06T18:35:57.554 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160778.log 2023-12-06T18:35:57.554 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154180.log 2023-12-06T18:35:57.554 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133624.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133624.log.gz 2023-12-06T18:35:57.554 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151169.log 2023-12-06T18:35:57.554 INFO:teuthology.orchestra.run.smithi123.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.160778.log.gz 2023-12-06T18:35:57.554 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147646.log 2023-12-06T18:35:57.554 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154180.log.gz 2023-12-06T18:35:57.555 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151169.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.151169.log.gz-5 2023-12-06T18:35:57.555 INFO:teuthology.orchestra.run.smithi123.stderr:--verbose -- /var/log/ceph/ceph-client.admin.128617.log 2023-12-06T18:35:57.555 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144788.log 2023-12-06T18:35:57.555 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147646.log.gz 2023-12-06T18:35:57.555 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152638.log 0.0% 2023-12-06T18:35:57.555 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.128617.log.gz 2023-12-06T18:35:57.555 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.144788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137363.log 2023-12-06T18:35:57.555 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144788.log.gz 2023-12-06T18:35:57.555 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150910.log 2023-12-06T18:35:57.556 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152638.log.gz 2023-12-06T18:35:57.556 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141816.log 2023-12-06T18:35:57.556 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137363.log.gz 2023-12-06T18:35:57.556 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150910.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150910.log.gz 2023-12-06T18:35:57.556 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160735.log 2023-12-06T18:35:57.556 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157274.log 2023-12-06T18:35:57.556 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141816.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141816.log.gz 2023-12-06T18:35:57.556 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128974.log 2023-12-06T18:35:57.556 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160735.log.gz 2023-12-06T18:35:57.557 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120190.log 2023-12-06T18:35:57.557 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157274.log.gz 2023-12-06T18:35:57.557 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145260.log 2023-12-06T18:35:57.557 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128974.log.gz 2023-12-06T18:35:57.557 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145174.log 2023-12-06T18:35:57.557 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120190.log.gz 2023-12-06T18:35:57.557 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164802.log 2023-12-06T18:35:57.557 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145260.log.gz 2023-12-06T18:35:57.557 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141665.log 2023-12-06T18:35:57.557 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145174.log.gz 2023-12-06T18:35:57.558 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.164802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132567.log 2023-12-06T18:35:57.558 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164802.log.gz 2023-12-06T18:35:57.558 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162309.log 2023-12-06T18:35:57.558 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141665.log.gz 2023-12-06T18:35:57.558 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132567.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132567.log.gz 2023-12-06T18:35:57.558 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130638.log 2023-12-06T18:35:57.558 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118210.log 2023-12-06T18:35:57.558 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162309.log.gz 2023-12-06T18:35:57.558 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127250.log 2023-12-06T18:35:57.559 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130638.log.gz 2023-12-06T18:35:57.559 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.118210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131730.log 2023-12-06T18:35:57.559 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118210.log.gz 2023-12-06T18:35:57.559 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133237.log 2023-12-06T18:35:57.559 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127250.log.gz 2023-12-06T18:35:57.559 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130449.log 2023-12-06T18:35:57.559 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131730.log.gz 2023-12-06T18:35:57.559 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148226.log 2023-12-06T18:35:57.559 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133237.log.gz 2023-12-06T18:35:57.560 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134855.log 2023-12-06T18:35:57.560 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130449.log.gz 2023-12-06T18:35:57.560 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148226.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.148226.log.gz-- 2023-12-06T18:35:57.560 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140818.log 2023-12-06T18:35:57.560 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141536.log 2023-12-06T18:35:57.560 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134855.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134855.log.gz 2023-12-06T18:35:57.560 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138227.log 2023-12-06T18:35:57.560 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140818.log.gz 2023-12-06T18:35:57.560 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149413.log 2023-12-06T18:35:57.561 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141536.log.gz 2023-12-06T18:35:57.561 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133898.log 2023-12-06T18:35:57.561 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138227.log.gz 2023-12-06T18:35:57.561 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138874.log 2023-12-06T18:35:57.561 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149413.log.gz 2023-12-06T18:35:57.561 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120596.log 2023-12-06T18:35:57.561 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133898.log.gz 2023-12-06T18:35:57.561 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158409.log 2023-12-06T18:35:57.561 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138874.log.gz 2023-12-06T18:35:57.562 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158079.log 2023-12-06T18:35:57.562 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120596.log.gz 2023-12-06T18:35:57.562 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160155.log 2023-12-06T18:35:57.562 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158409.log.gz 2023-12-06T18:35:57.562 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162972.log 2023-12-06T18:35:57.562 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158079.log.gz 2023-12-06T18:35:57.562 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130806.log 2023-12-06T18:35:57.562 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160155.log.gz 2023-12-06T18:35:57.562 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120317.log 2023-12-06T18:35:57.563 INFO:teuthology.orchestra.run.smithi123.stderr: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.162972.log.gz 2023-12-06T18:35:57.563 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136683.log 2023-12-06T18:35:57.563 INFO:teuthology.orchestra.run.smithi123.stderr: 24.3% -- replaced with /var/log/ceph/ceph-client.admin.130806.log.gz 2023-12-06T18:35:57.563 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121288.log 2023-12-06T18:35:57.563 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120317.log.gz 2023-12-06T18:35:57.563 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154339.log 2023-12-06T18:35:57.563 INFO:teuthology.orchestra.run.smithi123.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.136683.log.gz 2023-12-06T18:35:57.563 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160326.log 2023-12-06T18:35:57.563 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121288.log.gz 2023-12-06T18:35:57.564 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154339.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-12-06T18:35:57.564 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154339.log.gz 2023-12-06T18:35:57.564 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133689.log 2023-12-06T18:35:57.564 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160326.log.gz 2023-12-06T18:35:57.564 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156616.log 2023-12-06T18:35:57.564 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153889.log 2023-12-06T18:35:57.564 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133689.log.gz 2023-12-06T18:35:57.564 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144421.log 2023-12-06T18:35:57.564 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156616.log.gz 2023-12-06T18:35:57.565 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153889.log.gz 2023-12-06T18:35:57.565 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161783.log 2023-12-06T18:35:57.565 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.144421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159639.log 2023-12-06T18:35:57.565 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144421.log.gz 2023-12-06T18:35:57.565 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161783.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161783.log.gz 2023-12-06T18:35:57.565 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131499.log 2023-12-06T18:35:57.565 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119091.log 2023-12-06T18:35:57.565 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159639.log.gz 2023-12-06T18:35:57.565 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119641.log 0.0% 2023-12-06T18:35:57.566 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.131499.log.gz 2023-12-06T18:35:57.566 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149520.log 2023-12-06T18:35:57.566 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119091.log.gz 2023-12-06T18:35:57.566 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165341.log 2023-12-06T18:35:57.566 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119641.log.gz 2023-12-06T18:35:57.566 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134246.log 2023-12-06T18:35:57.566 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149520.log.gz 2023-12-06T18:35:57.566 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.165341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152079.log 2023-12-06T18:35:57.567 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165341.log.gz 2023-12-06T18:35:57.567 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128549.log 2023-12-06T18:35:57.567 INFO:teuthology.orchestra.run.smithi123.stderr: 18.5% -- replaced with /var/log/ceph/ceph-client.admin.134246.log.gz 2023-12-06T18:35:57.567 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139482.log 2023-12-06T18:35:57.567 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152079.log.gz 2023-12-06T18:35:57.567 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124856.log 2023-12-06T18:35:57.567 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128549.log.gz 2023-12-06T18:35:57.567 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141471.log 2023-12-06T18:35:57.567 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139482.log.gz 2023-12-06T18:35:57.568 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126410.log 2023-12-06T18:35:57.568 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124856.log.gz 2023-12-06T18:35:57.568 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160486.log 2023-12-06T18:35:57.568 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141471.log.gz 2023-12-06T18:35:57.568 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130995.log 2023-12-06T18:35:57.568 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126410.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126410.log.gz 2023-12-06T18:35:57.568 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136159.log 2023-12-06T18:35:57.568 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160486.log.gz 2023-12-06T18:35:57.568 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123280.log 2023-12-06T18:35:57.569 INFO:teuthology.orchestra.run.smithi123.stderr: 24.3% -- replaced with /var/log/ceph/ceph-client.admin.130995.log.gz 2023-12-06T18:35:57.569 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136159.log: 24.3% -- replaced with /var/log/ceph/ceph-client.admin.136159.log.gz 2023-12-06T18:35:57.569 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148370.log 2023-12-06T18:35:57.569 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141043.log 2023-12-06T18:35:57.569 INFO:teuthology.orchestra.run.smithi123.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.123280.log.gz 2023-12-06T18:35:57.569 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140894.log 2023-12-06T18:35:57.569 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148370.log.gz 2023-12-06T18:35:57.569 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141043.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141043.log.gz 2023-12-06T18:35:57.569 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161461.log 2023-12-06T18:35:57.569 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119263.log 2023-12-06T18:35:57.570 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140894.log.gz 2023-12-06T18:35:57.570 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128022.log 2023-12-06T18:35:57.570 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161461.log.gz 2023-12-06T18:35:57.570 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159832.log 2023-12-06T18:35:57.570 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119263.log.gz 2023-12-06T18:35:57.570 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128022.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128022.log.gz 2023-12-06T18:35:57.570 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123392.log 2023-12-06T18:35:57.570 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147775.log 2023-12-06T18:35:57.570 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159832.log.gz 2023-12-06T18:35:57.571 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149641.log 2023-12-06T18:35:57.571 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123392.log.gz 2023-12-06T18:35:57.571 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117326.log 2023-12-06T18:35:57.571 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147775.log.gz 2023-12-06T18:35:57.571 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149641.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.149641.log.gz/var/log/ceph/ceph-client.admin.155677.log 2023-12-06T18:35:57.571 INFO:teuthology.orchestra.run.smithi123.stderr: 2023-12-06T18:35:57.571 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.117326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129059.log 2023-12-06T18:35:57.571 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117326.log.gz 2023-12-06T18:35:57.571 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155221.log 2023-12-06T18:35:57.572 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155677.log.gz 2023-12-06T18:35:57.572 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141064.log 2023-12-06T18:35:57.572 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129059.log.gz 2023-12-06T18:35:57.572 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155221.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.155221.log.gz--verbose 2023-12-06T18:35:57.572 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.154592.log 2023-12-06T18:35:57.572 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122420.log 2023-12-06T18:35:57.572 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141064.log.gz 2023-12-06T18:35:57.572 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131858.log 2023-12-06T18:35:57.572 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154592.log.gz 2023-12-06T18:35:57.573 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126750.log 2023-12-06T18:35:57.573 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122420.log.gz 2023-12-06T18:35:57.573 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131858.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.131858.log.gz--verbose 2023-12-06T18:35:57.573 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.151108.log 2023-12-06T18:35:57.573 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145497.log 2023-12-06T18:35:57.573 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126750.log.gz 2023-12-06T18:35:57.573 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123030.log 2023-12-06T18:35:57.573 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151108.log.gz 2023-12-06T18:35:57.573 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161611.log 2023-12-06T18:35:57.574 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145497.log.gz 2023-12-06T18:35:57.574 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123030.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.123030.log.gz--verbose 2023-12-06T18:35:57.574 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.147517.log 2023-12-06T18:35:57.574 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128804.log 2023-12-06T18:35:57.574 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161611.log.gz 2023-12-06T18:35:57.574 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122871.log 2023-12-06T18:35:57.574 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147517.log.gz 2023-12-06T18:35:57.574 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157692.log 2023-12-06T18:35:57.574 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128804.log.gz 2023-12-06T18:35:57.575 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122871.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.122871.log.gz--verbose 2023-12-06T18:35:57.575 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.138597.log 2023-12-06T18:35:57.575 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140935.log 2023-12-06T18:35:57.575 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157692.log.gz 2023-12-06T18:35:57.575 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138597.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138597.log.gz 2023-12-06T18:35:57.575 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121186.log 2023-12-06T18:35:57.575 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155892.log 2023-12-06T18:35:57.575 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140935.log.gz 2023-12-06T18:35:57.575 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119697.log 2023-12-06T18:35:57.576 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121186.log.gz 2023-12-06T18:35:57.576 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140048.log 2023-12-06T18:35:57.576 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155892.log.gz 2023-12-06T18:35:57.576 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118703.log 2023-12-06T18:35:57.576 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119697.log.gz 2023-12-06T18:35:57.576 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125094.log 2023-12-06T18:35:57.576 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140048.log.gz 2023-12-06T18:35:57.576 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.118703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125791.log 2023-12-06T18:35:57.576 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118703.log.gz 2023-12-06T18:35:57.577 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144441.log 2023-12-06T18:35:57.577 INFO:teuthology.orchestra.run.smithi123.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.125094.log.gz 2023-12-06T18:35:57.577 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121388.log 2023-12-06T18:35:57.577 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125791.log.gz 2023-12-06T18:35:57.577 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.144441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137926.log 2023-12-06T18:35:57.577 INFO:teuthology.orchestra.run.smithi123.stderr: 55.7% -- replaced with /var/log/ceph/ceph-client.admin.144441.log.gz 2023-12-06T18:35:57.577 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131836.log 2023-12-06T18:35:57.577 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121388.log.gz 2023-12-06T18:35:57.577 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148897.log 2023-12-06T18:35:57.578 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137926.log.gz 2023-12-06T18:35:57.578 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147129.log 2023-12-06T18:35:57.578 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131836.log.gz 2023-12-06T18:35:57.578 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151087.log 2023-12-06T18:35:57.578 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148897.log.gz 2023-12-06T18:35:57.578 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133818.log 2023-12-06T18:35:57.578 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147129.log.gz 2023-12-06T18:35:57.578 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146136.log 2023-12-06T18:35:57.578 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151087.log.gz 2023-12-06T18:35:57.579 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154107.log 2023-12-06T18:35:57.579 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133818.log.gz 2023-12-06T18:35:57.579 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151069.log 2023-12-06T18:35:57.579 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146136.log.gz 2023-12-06T18:35:57.579 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140737.log 2023-12-06T18:35:57.579 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154107.log.gz 2023-12-06T18:35:57.579 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156424.log 2023-12-06T18:35:57.579 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151069.log.gz 2023-12-06T18:35:57.579 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140737.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.140737.log.gz-5 2023-12-06T18:35:57.580 INFO:teuthology.orchestra.run.smithi123.stderr:--verbose -- /var/log/ceph/ceph-client.admin.162116.log 2023-12-06T18:35:57.580 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149392.log 2023-12-06T18:35:57.580 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156424.log.gz 2023-12-06T18:35:57.580 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164981.log 2023-12-06T18:35:57.580 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162116.log.gz 2023-12-06T18:35:57.580 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153283.log 2023-12-06T18:35:57.580 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149392.log.gz 2023-12-06T18:35:57.580 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.164981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140675.log 2023-12-06T18:35:57.580 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164981.log.gz 2023-12-06T18:35:57.581 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139970.log 2023-12-06T18:35:57.581 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153283.log.gz 2023-12-06T18:35:57.581 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117571.log 2023-12-06T18:35:57.581 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140675.log.gz 2023-12-06T18:35:57.581 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156917.log 2023-12-06T18:35:57.581 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139970.log.gz 2023-12-06T18:35:57.581 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.117571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138205.log 2023-12-06T18:35:57.581 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117571.log.gz 2023-12-06T18:35:57.581 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118574.log 2023-12-06T18:35:57.581 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156917.log.gz 2023-12-06T18:35:57.582 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156143.log 2023-12-06T18:35:57.582 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138205.log.gz 2023-12-06T18:35:57.582 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.118574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131142.log 2023-12-06T18:35:57.582 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118574.log.gz 2023-12-06T18:35:57.582 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156143.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.156143.log.gz-5 2023-12-06T18:35:57.582 INFO:teuthology.orchestra.run.smithi123.stderr:--verbose -- /var/log/ceph/ceph-client.admin.130407.log 2023-12-06T18:35:57.582 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161654.log 2023-12-06T18:35:57.582 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131142.log.gz 2023-12-06T18:35:57.582 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155005.log 2023-12-06T18:35:57.583 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130407.log.gz 2023-12-06T18:35:57.583 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160509.log 2023-12-06T18:35:57.583 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161654.log.gz 2023-12-06T18:35:57.583 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155005.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.131016.log 2023-12-06T18:35:57.583 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.155005.log.gz 2023-12-06T18:35:57.583 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133495.log 2023-12-06T18:35:57.583 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160509.log.gz 2023-12-06T18:35:57.583 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142584.log 2023-12-06T18:35:57.583 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131016.log.gz 2023-12-06T18:35:57.584 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138421.log 2023-12-06T18:35:57.584 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133495.log.gz 2023-12-06T18:35:57.584 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142584.log: gzip -5 0.0%--verbose -- replaced with /var/log/ceph/ceph-client.admin.142584.log.gz-- 2023-12-06T18:35:57.584 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145002.log 2023-12-06T18:35:57.584 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147279.log 2023-12-06T18:35:57.584 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138421.log.gz 2023-12-06T18:35:57.584 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145002.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.145002.log.gz--verbose 2023-12-06T18:35:57.584 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.141128.log 2023-12-06T18:35:57.584 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122721.log 2023-12-06T18:35:57.585 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147279.log.gz 2023-12-06T18:35:57.585 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155614.log 2023-12-06T18:35:57.585 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141128.log.gz 2023-12-06T18:35:57.585 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155180.log 2023-12-06T18:35:57.585 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122721.log.gz 2023-12-06T18:35:57.585 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158469.log 2023-12-06T18:35:57.585 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155614.log.gz 2023-12-06T18:35:57.585 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137535.log 2023-12-06T18:35:57.585 INFO:teuthology.orchestra.run.smithi123.stderr: 53.3% -- replaced with /var/log/ceph/ceph-client.admin.155180.log.gz 2023-12-06T18:35:57.586 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155045.log 2023-12-06T18:35:57.586 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158469.log.gz 2023-12-06T18:35:57.586 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117620.log 2023-12-06T18:35:57.586 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137535.log.gz 2023-12-06T18:35:57.586 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153068.log 2023-12-06T18:35:57.586 INFO:teuthology.orchestra.run.smithi123.stderr: 53.5% -- replaced with /var/log/ceph/ceph-client.admin.155045.log.gz 2023-12-06T18:35:57.586 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.117620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153545.log 2023-12-06T18:35:57.586 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117620.log.gz 2023-12-06T18:35:57.586 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122355.log 2023-12-06T18:35:57.587 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153068.log.gz 2023-12-06T18:35:57.587 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126830.log 2023-12-06T18:35:57.587 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153545.log.gz 2023-12-06T18:35:57.587 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154668.log 2023-12-06T18:35:57.587 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122355.log.gz 2023-12-06T18:35:57.587 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156740.log 2023-12-06T18:35:57.587 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126830.log.gz 2023-12-06T18:35:57.587 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154668.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.154668.log.gz--verbose 2023-12-06T18:35:57.587 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.127971.log 2023-12-06T18:35:57.588 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130050.log 2023-12-06T18:35:57.588 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156740.log.gz 2023-12-06T18:35:57.588 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127971.log.gz 2023-12-06T18:35:57.588 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125859.log 2023-12-06T18:35:57.588 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153757.log 2023-12-06T18:35:57.588 INFO:teuthology.orchestra.run.smithi123.stderr: 24.0% -- replaced with /var/log/ceph/ceph-client.admin.130050.log.gz 2023-12-06T18:35:57.588 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125859.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.125859.log.gz 2023-12-06T18:35:57.588 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133409.log 2023-12-06T18:35:57.588 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151148.log 2023-12-06T18:35:57.589 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153757.log.gz 2023-12-06T18:35:57.589 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142246.log 0.0% 2023-12-06T18:35:57.589 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.133409.log.gz 2023-12-06T18:35:57.589 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123166.log 2023-12-06T18:35:57.589 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151148.log.gz 2023-12-06T18:35:57.589 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151929.log 2023-12-06T18:35:57.589 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142246.log.gz 2023-12-06T18:35:57.589 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143007.log 2023-12-06T18:35:57.589 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123166.log.gz 2023-12-06T18:35:57.590 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151929.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.139138.log 2023-12-06T18:35:57.590 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.151929.log.gz 2023-12-06T18:35:57.590 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.143007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161590.log 2023-12-06T18:35:57.590 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143007.log.gz 2023-12-06T18:35:57.590 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157058.log 0.0% 2023-12-06T18:35:57.590 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.139138.log.gz 2023-12-06T18:35:57.590 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151725.log 2023-12-06T18:35:57.590 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161590.log.gz 2023-12-06T18:35:57.591 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134961.log 2023-12-06T18:35:57.591 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157058.log.gz 2023-12-06T18:35:57.591 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129110.log 2023-12-06T18:35:57.591 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151725.log.gz 2023-12-06T18:35:57.591 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124312.log 2023-12-06T18:35:57.591 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134961.log.gz 2023-12-06T18:35:57.591 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153486.log 2023-12-06T18:35:57.591 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129110.log.gz 2023-12-06T18:35:57.591 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160383.log 2023-12-06T18:35:57.592 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124312.log.gz 2023-12-06T18:35:57.592 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130743.log 2023-12-06T18:35:57.592 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153486.log.gz 2023-12-06T18:35:57.592 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160198.log 2023-12-06T18:35:57.592 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160383.log.gz 2023-12-06T18:35:57.592 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154048.log 2023-12-06T18:35:57.592 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130743.log.gz 2023-12-06T18:35:57.592 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145411.log 2023-12-06T18:35:57.592 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160198.log.gz 2023-12-06T18:35:57.593 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160305.log 2023-12-06T18:35:57.593 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154048.log.gz 2023-12-06T18:35:57.593 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127610.log 2023-12-06T18:35:57.593 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145411.log.gz 2023-12-06T18:35:57.593 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137599.log 2023-12-06T18:35:57.593 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160305.log.gz 2023-12-06T18:35:57.593 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134405.log 2023-12-06T18:35:57.593 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127610.log.gz 2023-12-06T18:35:57.593 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145992.log 2023-12-06T18:35:57.594 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137599.log.gz 2023-12-06T18:35:57.594 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159875.log 2023-12-06T18:35:57.594 INFO:teuthology.orchestra.run.smithi123.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.134405.log.gz 2023-12-06T18:35:57.594 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140329.log 2023-12-06T18:35:57.594 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145992.log.gz 2023-12-06T18:35:57.594 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118746.log 2023-12-06T18:35:57.594 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159875.log.gz 2023-12-06T18:35:57.594 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138915.log 2023-12-06T18:35:57.594 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140329.log.gz 2023-12-06T18:35:57.595 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.118746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131901.log 2023-12-06T18:35:57.595 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118746.log.gz 2023-12-06T18:35:57.595 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162288.log 2023-12-06T18:35:57.595 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138915.log.gz 2023-12-06T18:35:57.595 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128226.log 2023-12-06T18:35:57.595 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131901.log.gz 2023-12-06T18:35:57.595 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148579.log 2023-12-06T18:35:57.595 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162288.log.gz 2023-12-06T18:35:57.595 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158929.log 2023-12-06T18:35:57.596 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128226.log.gz 2023-12-06T18:35:57.596 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131184.log 2023-12-06T18:35:57.596 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148579.log.gz 2023-12-06T18:35:57.596 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158929.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158929.log.gz 2023-12-06T18:35:57.596 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142772.log 2023-12-06T18:35:57.596 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138615.log 2023-12-06T18:35:57.596 INFO:teuthology.orchestra.run.smithi123.stderr: 24.0% -- replaced with /var/log/ceph/ceph-client.admin.131184.log.gz 2023-12-06T18:35:57.596 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159488.log 2023-12-06T18:35:57.597 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142772.log.gz 2023-12-06T18:35:57.597 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122011.log 2023-12-06T18:35:57.597 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138615.log.gz 2023-12-06T18:35:57.597 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124141.log 2023-12-06T18:35:57.597 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159488.log.gz 2023-12-06T18:35:57.597 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124652.log 2023-12-06T18:35:57.597 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122011.log.gz 2023-12-06T18:35:57.597 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129263.log 2023-12-06T18:35:57.597 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124141.log.gz 2023-12-06T18:35:57.598 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147495.log 2023-12-06T18:35:57.598 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124652.log.gz 2023-12-06T18:35:57.598 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129263.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129263.log.gz 2023-12-06T18:35:57.598 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148854.log 2023-12-06T18:35:57.598 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166139.log 2023-12-06T18:35:57.598 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147495.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147495.log.gz 2023-12-06T18:35:57.598 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131562.log 2023-12-06T18:35:57.598 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148854.log.gz 2023-12-06T18:35:57.598 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.166139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140611.log 2023-12-06T18:35:57.599 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166139.log.gz 2023-12-06T18:35:57.599 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131562.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131562.log.gz 2023-12-06T18:35:57.599 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158241.log 2023-12-06T18:35:57.599 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141107.log 2023-12-06T18:35:57.599 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140611.log.gz 2023-12-06T18:35:57.599 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142332.log 2023-12-06T18:35:57.599 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158241.log.gz 2023-12-06T18:35:57.599 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135981.log 2023-12-06T18:35:57.599 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141107.log.gz 2023-12-06T18:35:57.600 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134665.log 2023-12-06T18:35:57.600 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142332.log.gz 2023-12-06T18:35:57.600 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145648.log 2023-12-06T18:35:57.600 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135981.log.gz 2023-12-06T18:35:57.600 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156957.log 2023-12-06T18:35:57.600 INFO:teuthology.orchestra.run.smithi123.stderr: 15.1% -- replaced with /var/log/ceph/ceph-client.admin.134665.log.gz 2023-12-06T18:35:57.600 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120531.log 2023-12-06T18:35:57.600 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145648.log.gz 2023-12-06T18:35:57.600 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149435.log 2023-12-06T18:35:57.601 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156957.log.gz 2023-12-06T18:35:57.601 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154218.log 2023-12-06T18:35:57.601 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120531.log.gz 2023-12-06T18:35:57.601 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149435.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149435.log.gz 2023-12-06T18:35:57.601 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133323.log 2023-12-06T18:35:57.601 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157412.log 2023-12-06T18:35:57.601 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154218.log.gz 2023-12-06T18:35:57.601 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130281.log 2023-12-06T18:35:57.601 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133323.log.gz 2023-12-06T18:35:57.602 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141729.log 2023-12-06T18:35:57.602 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157412.log.gz 2023-12-06T18:35:57.602 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133022.log 2023-12-06T18:35:57.602 INFO:teuthology.orchestra.run.smithi123.stderr: 24.0% -- replaced with /var/log/ceph/ceph-client.admin.130281.log.gz 2023-12-06T18:35:57.602 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158302.log 2023-12-06T18:35:57.602 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141729.log.gz 2023-12-06T18:35:57.602 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124380.log 2023-12-06T18:35:57.602 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133022.log.gz 2023-12-06T18:35:57.602 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146242.log 2023-12-06T18:35:57.603 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158302.log.gz 2023-12-06T18:35:57.603 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159510.log 2023-12-06T18:35:57.603 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124380.log.gz 2023-12-06T18:35:57.603 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152337.log 2023-12-06T18:35:57.603 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146242.log.gz 2023-12-06T18:35:57.603 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159510.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159510.log.gz 2023-12-06T18:35:57.603 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153735.log 2023-12-06T18:35:57.603 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146177.log 2023-12-06T18:35:57.603 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152337.log.gz 2023-12-06T18:35:57.604 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127530.log 2023-12-06T18:35:57.604 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153735.log.gz 2023-12-06T18:35:57.604 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146177.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.146177.log.gz 2023-12-06T18:35:57.604 INFO:teuthology.orchestra.run.smithi123.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.143651.log 2023-12-06T18:35:57.604 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135544.log 2023-12-06T18:35:57.604 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127530.log.gz 2023-12-06T18:35:57.604 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.143651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137797.log 2023-12-06T18:35:57.604 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.143651.log.gz 2023-12-06T18:35:57.604 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151302.log 2023-12-06T18:35:57.604 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135544.log.gz 2023-12-06T18:35:57.605 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130722.log 2023-12-06T18:35:57.605 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137797.log.gz 2023-12-06T18:35:57.605 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149621.log 2023-12-06T18:35:57.605 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151302.log.gz 2023-12-06T18:35:57.605 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146721.log 2023-12-06T18:35:57.605 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130722.log.gz 2023-12-06T18:35:57.605 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150758.log 2023-12-06T18:35:57.605 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149621.log.gz 2023-12-06T18:35:57.606 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152359.log 2023-12-06T18:35:57.606 INFO:teuthology.orchestra.run.smithi123.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.146721.log.gz 2023-12-06T18:35:57.606 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146743.log 2023-12-06T18:35:57.606 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150758.log.gz 2023-12-06T18:35:57.606 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152767.log 2023-12-06T18:35:57.606 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152359.log.gz 2023-12-06T18:35:57.606 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148328.log 2023-12-06T18:35:57.606 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146743.log.gz 2023-12-06T18:35:57.607 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135845.log 2023-12-06T18:35:57.607 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152767.log.gz 2023-12-06T18:35:57.607 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152918.log 2023-12-06T18:35:57.607 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148328.log.gz 2023-12-06T18:35:57.607 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149537.log 2023-12-06T18:35:57.607 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.135845.log.gz 2023-12-06T18:35:57.607 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139990.log 2023-12-06T18:35:57.607 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152918.log.gz 2023-12-06T18:35:57.607 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126670.log 2023-12-06T18:35:57.608 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149537.log.gz 2023-12-06T18:35:57.608 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125400.log 2023-12-06T18:35:57.608 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.139990.log.gz 2023-12-06T18:35:57.608 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148054.log 2023-12-06T18:35:57.608 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126670.log.gz 2023-12-06T18:35:57.608 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136704.log 2023-12-06T18:35:57.608 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125400.log.gz 2023-12-06T18:35:57.608 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148392.log 2023-12-06T18:35:57.608 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148054.log.gz 2023-12-06T18:35:57.609 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161353.log 2023-12-06T18:35:57.609 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136704.log.gz 2023-12-06T18:35:57.609 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149878.log 2023-12-06T18:35:57.609 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148392.log.gz 2023-12-06T18:35:57.609 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133581.log 2023-12-06T18:35:57.609 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161353.log.gz 2023-12-06T18:35:57.609 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139827.log 2023-12-06T18:35:57.609 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149878.log.gz 2023-12-06T18:35:57.610 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122441.log 2023-12-06T18:35:57.610 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133581.log.gz 2023-12-06T18:35:57.610 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135763.log 2023-12-06T18:35:57.610 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139827.log.gz 2023-12-06T18:35:57.610 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160343.log 2023-12-06T18:35:57.610 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122441.log.gz 2023-12-06T18:35:57.610 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130932.log 2023-12-06T18:35:57.610 INFO:teuthology.orchestra.run.smithi123.stderr: 54.1% -- replaced with /var/log/ceph/ceph-client.admin.135763.log.gz 2023-12-06T18:35:57.610 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133981.log 2023-12-06T18:35:57.611 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160343.log.gz 2023-12-06T18:35:57.611 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120660.log 2023-12-06T18:35:57.611 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130932.log.gz 2023-12-06T18:35:57.611 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134426.log 2023-12-06T18:35:57.611 INFO:teuthology.orchestra.run.smithi123.stderr: 55.1% -- replaced with /var/log/ceph/ceph-client.admin.133981.log.gz 2023-12-06T18:35:57.611 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137191.log 2023-12-06T18:35:57.611 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120660.log.gz 2023-12-06T18:35:57.611 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117228.log 2023-12-06T18:35:57.612 INFO:teuthology.orchestra.run.smithi123.stderr: 24.1% -- replaced with /var/log/ceph/ceph-client.admin.134426.log.gz 2023-12-06T18:35:57.612 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159381.log 2023-12-06T18:35:57.612 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137191.log.gz 2023-12-06T18:35:57.612 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.117228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128362.log 2023-12-06T18:35:57.612 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117228.log.gz 2023-12-06T18:35:57.612 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159381.log.gz 2023-12-06T18:35:57.612 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128362.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128362.log.gz 2023-12-06T18:35:57.612 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124635.log 2023-12-06T18:35:57.612 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157885.log 2023-12-06T18:35:57.613 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123841.log 2023-12-06T18:35:57.613 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124635.log.gz 2023-12-06T18:35:57.613 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157885.log.gz 2023-12-06T18:35:57.613 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118875.log 2023-12-06T18:35:57.613 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160652.log 2023-12-06T18:35:57.613 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123841.log.gz 2023-12-06T18:35:57.613 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.118875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149198.log 2023-12-06T18:35:57.613 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118875.log.gz 2023-12-06T18:35:57.614 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128668.log 2023-12-06T18:35:57.614 INFO:teuthology.orchestra.run.smithi123.stderr: 11.1% -- replaced with /var/log/ceph/ceph-client.admin.160652.log.gz 2023-12-06T18:35:57.614 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121733.log 2023-12-06T18:35:57.614 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149198.log.gz 2023-12-06T18:35:57.614 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132876.log 2023-12-06T18:35:57.614 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128668.log.gz 2023-12-06T18:35:57.614 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124465.log 2023-12-06T18:35:57.614 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121733.log.gz 2023-12-06T18:35:57.614 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139009.log 2023-12-06T18:35:57.615 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132876.log.gz 2023-12-06T18:35:57.615 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127770.log 2023-12-06T18:35:57.615 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124465.log.gz 2023-12-06T18:35:57.615 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118789.log 2023-12-06T18:35:57.615 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139009.log.gz 2023-12-06T18:35:57.615 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131037.log 2023-12-06T18:35:57.615 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127770.log.gz 2023-12-06T18:35:57.615 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.118789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159703.log 2023-12-06T18:35:57.616 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118789.log.gz 2023-12-06T18:35:57.616 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155202.log 2023-12-06T18:35:57.616 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131037.log.gz 2023-12-06T18:35:57.616 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136500.log 2023-12-06T18:35:57.616 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159703.log.gz 2023-12-06T18:35:57.616 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120057.log 2023-12-06T18:35:57.616 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155202.log.gz 2023-12-06T18:35:57.616 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153776.log 2023-12-06T18:35:57.616 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136500.log.gz 2023-12-06T18:35:57.617 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119600.log 2023-12-06T18:35:57.617 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120057.log.gz 2023-12-06T18:35:57.617 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161568.log 2023-12-06T18:35:57.617 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153776.log.gz 2023-12-06T18:35:57.617 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137969.log 2023-12-06T18:35:57.617 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119600.log.gz 2023-12-06T18:35:57.617 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119069.log 2023-12-06T18:35:57.617 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161568.log.gz 2023-12-06T18:35:57.618 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128736.log 2023-12-06T18:35:57.618 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137969.log.gz 2023-12-06T18:35:57.618 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141193.log 2023-12-06T18:35:57.618 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119069.log.gz 2023-12-06T18:35:57.618 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128736.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128736.log.gz 2023-12-06T18:35:57.618 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141001.log 2023-12-06T18:35:57.618 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126090.log 2023-12-06T18:35:57.618 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141193.log.gz 2023-12-06T18:35:57.618 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139590.log 2023-12-06T18:35:57.619 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141001.log.gz 2023-12-06T18:35:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129882.log 2023-12-06T18:35:57.619 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126090.log.gz 2023-12-06T18:35:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153638.log 2023-12-06T18:35:57.619 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139590.log.gz 2023-12-06T18:35:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156897.log 2023-12-06T18:35:57.619 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129882.log.gz 2023-12-06T18:35:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132609.log 2023-12-06T18:35:57.619 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153638.log.gz 2023-12-06T18:35:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121326.log 2023-12-06T18:35:57.620 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156897.log.gz 2023-12-06T18:35:57.620 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118724.log 2023-12-06T18:35:57.620 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132609.log.gz 2023-12-06T18:35:57.620 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152445.log 2023-12-06T18:35:57.620 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121326.log.gz 2023-12-06T18:35:57.620 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.118724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160632.log 2023-12-06T18:35:57.620 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118724.log.gz 2023-12-06T18:35:57.620 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162460.log 2023-12-06T18:35:57.621 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152445.log.gz 2023-12-06T18:35:57.621 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119198.log 2023-12-06T18:35:57.621 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160632.log.gz 2023-12-06T18:35:57.621 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151283.log 2023-12-06T18:35:57.621 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162460.log.gz 2023-12-06T18:35:57.621 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155853.log 2023-12-06T18:35:57.621 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119198.log.gz 2023-12-06T18:35:57.621 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138932.log 2023-12-06T18:35:57.621 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151283.log.gz 2023-12-06T18:35:57.622 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155853.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155853.log.gz 2023-12-06T18:35:57.622 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141022.log 2023-12-06T18:35:57.622 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152574.log 2023-12-06T18:35:57.622 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138932.log.gz 2023-12-06T18:35:57.622 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152595.log 2023-12-06T18:35:57.622 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141022.log.gz 2023-12-06T18:35:57.622 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134725.log 2023-12-06T18:35:57.622 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152574.log.gz 2023-12-06T18:35:57.623 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158014.log 2023-12-06T18:35:57.623 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152595.log.gz 2023-12-06T18:35:57.623 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136662.log 2023-12-06T18:35:57.623 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134725.log.gz 2023-12-06T18:35:57.623 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151702.log 2023-12-06T18:35:57.623 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158014.log.gz 2023-12-06T18:35:57.623 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145454.log 2023-12-06T18:35:57.623 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136662.log.gz 2023-12-06T18:35:57.623 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152036.log 2023-12-06T18:35:57.624 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151702.log.gz 2023-12-06T18:35:57.624 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146262.log 2023-12-06T18:35:57.624 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145454.log.gz 2023-12-06T18:35:57.624 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141257.log 2023-12-06T18:35:57.624 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152036.log.gz 2023-12-06T18:35:57.624 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161911.log 2023-12-06T18:35:57.624 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146262.log.gz 2023-12-06T18:35:57.624 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140371.log 2023-12-06T18:35:57.624 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141257.log.gz 2023-12-06T18:35:57.625 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126370.log 2023-12-06T18:35:57.625 INFO:teuthology.orchestra.run.smithi123.stderr: 23.2% -- replaced with /var/log/ceph/ceph-client.admin.161911.log.gz 2023-12-06T18:35:57.625 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147021.log 0.0% 2023-12-06T18:35:57.625 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.140371.log.gz 2023-12-06T18:35:57.625 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123183.log 2023-12-06T18:35:57.625 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126370.log.gz 2023-12-06T18:35:57.625 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147753.log 2023-12-06T18:35:57.625 INFO:teuthology.orchestra.run.smithi123.stderr: 22.9% -- replaced with /var/log/ceph/ceph-client.admin.147021.log.gz 2023-12-06T18:35:57.626 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130701.log 2023-12-06T18:35:57.626 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123183.log.gz 2023-12-06T18:35:57.626 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117375.log 2023-12-06T18:35:57.626 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147753.log.gz 2023-12-06T18:35:57.626 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128923.log 2023-12-06T18:35:57.626 INFO:teuthology.orchestra.run.smithi123.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.130701.log.gz 2023-12-06T18:35:57.626 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.117375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146828.log 2023-12-06T18:35:57.626 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117375.log.gz 2023-12-06T18:35:57.626 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140287.log 2023-12-06T18:35:57.627 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128923.log.gz 2023-12-06T18:35:57.627 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134363.log 2023-12-06T18:35:57.627 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146828.log.gz 2023-12-06T18:35:57.627 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136280.log 2023-12-06T18:35:57.627 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140287.log.gz 2023-12-06T18:35:57.627 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155257.log 2023-12-06T18:35:57.627 INFO:teuthology.orchestra.run.smithi123.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.134363.log.gz 2023-12-06T18:35:57.627 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120255.log 2023-12-06T18:35:57.627 INFO:teuthology.orchestra.run.smithi123.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.136280.log.gz 2023-12-06T18:35:57.628 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155257.log.gz 2023-12-06T18:35:57.628 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159725.log 2023-12-06T18:35:57.628 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139375.log 2023-12-06T18:35:57.628 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120255.log.gz 2023-12-06T18:35:57.628 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145628.log 2023-12-06T18:35:57.628 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159725.log.gz 2023-12-06T18:35:57.628 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123454.log 2023-12-06T18:35:57.629 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139375.log.gz 2023-12-06T18:35:57.629 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142117.log 2023-12-06T18:35:57.629 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145628.log.gz 2023-12-06T18:35:57.629 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136002.log 2023-12-06T18:35:57.629 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123454.log.gz 2023-12-06T18:35:57.629 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149349.log 2023-12-06T18:35:57.629 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142117.log.gz 2023-12-06T18:35:57.629 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138949.log 2023-12-06T18:35:57.629 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136002.log.gz 2023-12-06T18:35:57.630 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124805.log 2023-12-06T18:35:57.630 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149349.log.gz 2023-12-06T18:35:57.630 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148622.log 2023-12-06T18:35:57.630 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138949.log.gz 2023-12-06T18:35:57.630 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164753.log 2023-12-06T18:35:57.630 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124805.log.gz 2023-12-06T18:35:57.630 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156030.log 2023-12-06T18:35:57.630 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148622.log.gz 2023-12-06T18:35:57.631 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.164753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154802.log 2023-12-06T18:35:57.631 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164753.log.gz 2023-12-06T18:35:57.631 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145368.log 2023-12-06T18:35:57.631 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156030.log.gz 2023-12-06T18:35:57.631 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159424.log 2023-12-06T18:35:57.631 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154802.log.gz 2023-12-06T18:35:57.631 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128260.log 2023-12-06T18:35:57.631 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145368.log.gz 2023-12-06T18:35:57.631 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158972.log 2023-12-06T18:35:57.631 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159424.log.gz 2023-12-06T18:35:57.632 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120276.log 2023-12-06T18:35:57.632 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128260.log.gz 2023-12-06T18:35:57.632 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154143.log 2023-12-06T18:35:57.632 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158972.log.gz 2023-12-06T18:35:57.632 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148494.log 2023-12-06T18:35:57.632 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120276.log.gz 2023-12-06T18:35:57.632 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118595.log 2023-12-06T18:35:57.632 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154143.log.gz 2023-12-06T18:35:57.633 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126250.log 2023-12-06T18:35:57.633 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148494.log.gz 2023-12-06T18:35:57.633 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.118595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164704.log 2023-12-06T18:35:57.633 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118595.log.gz 2023-12-06T18:35:57.633 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145868.log 2023-12-06T18:35:57.633 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126250.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126250.log.gz 2023-12-06T18:35:57.633 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.164704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150813.log 2023-12-06T18:35:57.633 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164704.log.gz 2023-12-06T18:35:57.633 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161117.log 2023-12-06T18:35:57.634 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145868.log.gz 2023-12-06T18:35:57.634 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150813.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.141924.log 2023-12-06T18:35:57.634 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.150813.log.gz 2023-12-06T18:35:57.634 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129399.log 2023-12-06T18:35:57.634 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161117.log.gz 2023-12-06T18:35:57.634 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159209.log 2023-12-06T18:35:57.634 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141924.log.gz 2023-12-06T18:35:57.634 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159983.log 2023-12-06T18:35:57.634 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129399.log.gz 2023-12-06T18:35:57.635 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162761.log 2023-12-06T18:35:57.635 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159209.log.gz 2023-12-06T18:35:57.635 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158489.log 2023-12-06T18:35:57.635 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159983.log.gz 2023-12-06T18:35:57.635 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129484.log 2023-12-06T18:35:57.635 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162761.log.gz 2023-12-06T18:35:57.635 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158489.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158489.log.gz 2023-12-06T18:35:57.635 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125043.log 2023-12-06T18:35:57.635 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132460.log 2023-12-06T18:35:57.636 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129484.log.gz 2023-12-06T18:35:57.636 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132739.log 2023-12-06T18:35:57.636 INFO:teuthology.orchestra.run.smithi123.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.125043.log.gz 2023-12-06T18:35:57.636 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160069.log 2023-12-06T18:35:57.636 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132460.log.gz 2023-12-06T18:35:57.636 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129144.log 2023-12-06T18:35:57.636 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132739.log.gz 2023-12-06T18:35:57.636 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150199.log 2023-12-06T18:35:57.636 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160069.log.gz 2023-12-06T18:35:57.637 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131793.log 2023-12-06T18:35:57.637 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129144.log.gz 2023-12-06T18:35:57.637 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130512.log 2023-12-06T18:35:57.637 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150199.log.gz 2023-12-06T18:35:57.637 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156049.log 2023-12-06T18:35:57.637 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131793.log.gz 2023-12-06T18:35:57.637 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157799.log 2023-12-06T18:35:57.637 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130512.log.gz 2023-12-06T18:35:57.638 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121925.log 2023-12-06T18:35:57.638 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156049.log.gz 2023-12-06T18:35:57.638 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123755.log 2023-12-06T18:35:57.638 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157799.log.gz 2023-12-06T18:35:57.638 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145110.log 2023-12-06T18:35:57.638 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121925.log.gz 2023-12-06T18:35:57.638 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129535.log 2023-12-06T18:35:57.638 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123755.log.gz 2023-12-06T18:35:57.638 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141364.log 2023-12-06T18:35:57.639 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145110.log.gz 2023-12-06T18:35:57.639 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129535.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.129535.log.gz--verbose 2023-12-06T18:35:57.639 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.153585.log 2023-12-06T18:35:57.639 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141364.log.gz 2023-12-06T18:35:57.639 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129246.log 2023-12-06T18:35:57.639 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138632.log 2023-12-06T18:35:57.639 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153585.log.gz 2023-12-06T18:35:57.639 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153154.log 2023-12-06T18:35:57.639 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129246.log.gz 2023-12-06T18:35:57.640 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150350.log 2023-12-06T18:35:57.640 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138632.log.gz 2023-12-06T18:35:57.640 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126490.log 2023-12-06T18:35:57.640 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153154.log.gz 2023-12-06T18:35:57.640 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142690.log 2023-12-06T18:35:57.640 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150350.log.gz 2023-12-06T18:35:57.640 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140090.log 2023-12-06T18:35:57.640 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126490.log.gz 2023-12-06T18:35:57.640 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142690.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.142690.log.gz--verbose 2023-12-06T18:35:57.641 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.143415.log 2023-12-06T18:35:57.641 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145952.log 2023-12-06T18:35:57.641 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140090.log.gz 2023-12-06T18:35:57.641 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.143415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148940.log 2023-12-06T18:35:57.641 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143415.log.gz 2023-12-06T18:35:57.641 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145952.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145952.log.gz 2023-12-06T18:35:57.641 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136621.log 2023-12-06T18:35:57.641 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147796.log 2023-12-06T18:35:57.641 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148940.log.gz 2023-12-06T18:35:57.642 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141385.log 2023-12-06T18:35:57.642 INFO:teuthology.orchestra.run.smithi123.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.136621.log.gz 2023-12-06T18:35:57.642 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155635.log 2023-12-06T18:35:57.642 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147796.log.gz 2023-12-06T18:35:57.642 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142921.log 2023-12-06T18:35:57.642 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141385.log.gz 2023-12-06T18:35:57.642 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122699.log 2023-12-06T18:35:57.642 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155635.log.gz 2023-12-06T18:35:57.642 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147236.log 2023-12-06T18:35:57.643 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142921.log.gz 2023-12-06T18:35:57.643 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141214.log 2023-12-06T18:35:57.643 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122699.log.gz 2023-12-06T18:35:57.643 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147236.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147236.log.gz 2023-12-06T18:35:57.643 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122635.log 2023-12-06T18:35:57.643 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157821.log 2023-12-06T18:35:57.643 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141214.log.gz 2023-12-06T18:35:57.643 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127590.log 2023-12-06T18:35:57.643 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122635.log.gz 2023-12-06T18:35:57.644 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157018.log 2023-12-06T18:35:57.644 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157821.log.gz 2023-12-06T18:35:57.644 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120297.log 2023-12-06T18:35:57.644 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127590.log.gz 2023-12-06T18:35:57.644 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124771.log 2023-12-06T18:35:57.644 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157018.log.gz 2023-12-06T18:35:57.644 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125689.log 2023-12-06T18:35:57.644 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120297.log.gz 2023-12-06T18:35:57.644 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132288.log 2023-12-06T18:35:57.645 INFO:teuthology.orchestra.run.smithi123.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.124771.log.gz 2023-12-06T18:35:57.645 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143523.log 2023-12-06T18:35:57.645 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125689.log.gz 2023-12-06T18:35:57.645 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126470.log 2023-12-06T18:35:57.645 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132288.log.gz 2023-12-06T18:35:57.645 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.143523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139568.log 2023-12-06T18:35:57.645 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143523.log.gz 2023-12-06T18:35:57.645 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157117.log 2023-12-06T18:35:57.645 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126470.log.gz 2023-12-06T18:35:57.646 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124941.log 2023-12-06T18:35:57.646 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139568.log.gz 2023-12-06T18:35:57.646 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128039.log 2023-12-06T18:35:57.646 INFO:teuthology.orchestra.run.smithi123.stderr: 55.5% -- replaced with /var/log/ceph/ceph-client.admin.157117.log.gz 2023-12-06T18:35:57.646 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138792.log 2023-12-06T18:35:57.646 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124941.log.gz 2023-12-06T18:35:57.646 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134146.log 2023-12-06T18:35:57.646 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128039.log.gz 2023-12-06T18:35:57.646 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136300.log 2023-12-06T18:35:57.647 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138792.log.gz 2023-12-06T18:35:57.647 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156518.log 2023-12-06T18:35:57.647 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134146.log.gz 2023-12-06T18:35:57.647 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136300.log: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.136300.log.gz 2023-12-06T18:35:57.647 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122592.log 2023-12-06T18:35:57.647 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121165.log 2023-12-06T18:35:57.647 INFO:teuthology.orchestra.run.smithi123.stderr: 53.7% -- replaced with /var/log/ceph/ceph-client.admin.156518.log.gz 2023-12-06T18:35:57.647 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159553.log 2023-12-06T18:35:57.647 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122592.log.gz 2023-12-06T18:35:57.648 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140591.log 2023-12-06T18:35:57.648 INFO:teuthology.orchestra.run.smithi123.stderr: 5.3% -- replaced with /var/log/ceph/ceph-client.admin.121165.log.gz 2023-12-06T18:35:57.648 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136541.log 2023-12-06T18:35:57.648 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159553.log.gz 2023-12-06T18:35:57.648 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156797.log 2023-12-06T18:35:57.648 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140591.log.gz 2023-12-06T18:35:57.648 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139074.log 2023-12-06T18:35:57.648 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136541.log.gz 2023-12-06T18:35:57.648 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161074.log 2023-12-06T18:35:57.649 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156797.log.gz 2023-12-06T18:35:57.649 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139074.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139074.log.gz 2023-12-06T18:35:57.649 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158036.log 2023-12-06T18:35:57.649 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119887.log 2023-12-06T18:35:57.649 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161074.log.gz 2023-12-06T18:35:57.649 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128515.log 2023-12-06T18:35:57.649 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158036.log.gz 2023-12-06T18:35:57.649 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135940.log 2023-12-06T18:35:57.650 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.119887.log.gz 2023-12-06T18:35:57.650 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137385.log 2023-12-06T18:35:57.650 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128515.log.gz 2023-12-06T18:35:57.650 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121453.log 2023-12-06T18:35:57.650 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135940.log.gz 2023-12-06T18:35:57.650 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120897.log 2023-12-06T18:35:57.650 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137385.log.gz 2023-12-06T18:35:57.650 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121539.log 2023-12-06T18:35:57.650 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121453.log.gz 2023-12-06T18:35:57.651 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120897.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120897.log.gz 2023-12-06T18:35:57.651 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131310.log 2023-12-06T18:35:57.651 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138472.log 2023-12-06T18:35:57.651 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121539.log.gz 2023-12-06T18:35:57.651 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154066.log 2023-12-06T18:35:57.651 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131310.log.gz 2023-12-06T18:35:57.651 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152896.log 2023-12-06T18:35:57.651 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138472.log.gz 2023-12-06T18:35:57.651 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120875.log 2023-12-06T18:35:57.652 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154066.log.gz 2023-12-06T18:35:57.652 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165496.log 2023-12-06T18:35:57.652 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152896.log.gz 2023-12-06T18:35:57.652 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120875.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-12-06T18:35:57.652 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120875.log.gz 2023-12-06T18:35:57.652 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.165496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126970.log 2023-12-06T18:35:57.652 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165496.log.gz 2023-12-06T18:35:57.652 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158530.log 2023-12-06T18:35:57.652 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126970.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126970.log.gz 2023-12-06T18:35:57.652 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146282.log 2023-12-06T18:35:57.653 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145088.log 2023-12-06T18:35:57.653 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158530.log: 24.3% -- replaced with /var/log/ceph/ceph-client.admin.158530.log.gz 2023-12-06T18:35:57.653 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146282.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.146282.log.gz--verbose 2023-12-06T18:35:57.653 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.161289.log 2023-12-06T18:35:57.653 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122678.log 2023-12-06T18:35:57.653 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145088.log.gz 2023-12-06T18:35:57.653 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121904.log 2023-12-06T18:35:57.653 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161289.log.gz 2023-12-06T18:35:57.653 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122678.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122678.log.gz 2023-12-06T18:35:57.654 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127650.log 2023-12-06T18:35:57.654 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138400.log 2023-12-06T18:35:57.654 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121904.log: 24.9% -- replaced with /var/log/ceph/ceph-client.admin.121904.log.gz 2023-12-06T18:35:57.654 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150049.log 2023-12-06T18:35:57.654 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127650.log.gz 2023-12-06T18:35:57.654 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138400.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138400.log.gz 2023-12-06T18:35:57.654 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126050.log 2023-12-06T18:35:57.654 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160550.log 2023-12-06T18:35:57.655 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150049.log.gz 2023-12-06T18:35:57.655 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153025.log 2023-12-06T18:35:57.655 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126050.log.gz 2023-12-06T18:35:57.655 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160550.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160550.log.gz 2023-12-06T18:35:57.655 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162846.log 2023-12-06T18:35:57.655 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.153025.log: -- /var/log/ceph/ceph-client.admin.132978.log 2023-12-06T18:35:57.655 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153025.log.gz 2023-12-06T18:35:57.655 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156203.log 2023-12-06T18:35:57.655 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162846.log.gz 2023-12-06T18:35:57.655 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147925.log 2023-12-06T18:35:57.656 INFO:teuthology.orchestra.run.smithi123.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.132978.log.gz 2023-12-06T18:35:57.656 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142857.log 2023-12-06T18:35:57.656 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156203.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156203.log.gz 2023-12-06T18:35:57.656 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140239.log 2023-12-06T18:35:57.656 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147925.log.gz 2023-12-06T18:35:57.656 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142857.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142857.log.gz 2023-12-06T18:35:57.656 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148747.log 2023-12-06T18:35:57.656 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160026.log 2023-12-06T18:35:57.656 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140239.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140239.log.gz 2023-12-06T18:35:57.657 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129297.log 2023-12-06T18:35:57.657 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148747.log.gz 2023-12-06T18:35:57.657 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160026.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160026.log.gz 2023-12-06T18:35:57.657 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136080.log 2023-12-06T18:35:57.657 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158323.log 2023-12-06T18:35:57.657 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129297.log.gz 2023-12-06T18:35:57.657 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130176.log 2023-12-06T18:35:57.657 INFO:teuthology.orchestra.run.smithi123.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.136080.log.gz 2023-12-06T18:35:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158323.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.158323.log.gz--verbose 2023-12-06T18:35:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.130911.log 2023-12-06T18:35:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139928.log 2023-12-06T18:35:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130176.log.gz 2023-12-06T18:35:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126190.log 2023-12-06T18:35:57.658 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130911.log.gz 2023-12-06T18:35:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139928.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139928.log.gz 2023-12-06T18:35:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129331.log 2023-12-06T18:35:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123356.log 2023-12-06T18:35:57.659 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126190.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126190.log.gz 2023-12-06T18:35:57.659 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148011.log 2023-12-06T18:35:57.659 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129331.log.gz 2023-12-06T18:35:57.659 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127988.log 2023-12-06T18:35:57.659 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123356.log.gz 2023-12-06T18:35:57.659 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.148011.log: -- /var/log/ceph/ceph-client.admin.150156.log 2023-12-06T18:35:57.659 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148011.log.gz 2023-12-06T18:35:57.659 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153047.log 2023-12-06T18:35:57.659 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127988.log.gz 2023-12-06T18:35:57.660 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150156.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150156.log.gz 2023-12-06T18:35:57.660 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153621.log 2023-12-06T18:35:57.660 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127750.log 2023-12-06T18:35:57.660 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153047.log.gz 2023-12-06T18:35:57.660 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146468.log 2023-12-06T18:35:57.660 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153621.log.gz 2023-12-06T18:35:57.660 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127750.log.gz 2023-12-06T18:35:57.660 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126450.log 2023-12-06T18:35:57.660 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164655.log 2023-12-06T18:35:57.661 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146468.log.gz 2023-12-06T18:35:57.661 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126450.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126450.log.gz 2023-12-06T18:35:57.661 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129433.log 2023-12-06T18:35:57.661 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130953.log 2023-12-06T18:35:57.661 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.164655.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164655.log.gz 2023-12-06T18:35:57.661 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129433.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.162718.log 2023-12-06T18:35:57.661 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.129433.log.gz 2023-12-06T18:35:57.661 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130953.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130953.log.gz 2023-12-06T18:35:57.661 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150868.log 2023-12-06T18:35:57.662 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132588.log 2023-12-06T18:35:57.662 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162718.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162718.log.gz 2023-12-06T18:35:57.662 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160090.log 2023-12-06T18:35:57.662 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150868.log.gz 2023-12-06T18:35:57.662 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150586.log 2023-12-06T18:35:57.662 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132588.log.gz 2023-12-06T18:35:57.662 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125247.log 2023-12-06T18:35:57.662 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160090.log.gz 2023-12-06T18:35:57.663 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118161.log 2023-12-06T18:35:57.663 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150586.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150586.log.gz 2023-12-06T18:35:57.663 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136562.log 2023-12-06T18:35:57.663 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125247.log.gz 2023-12-06T18:35:57.663 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.118161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151223.log 0.0% 2023-12-06T18:35:57.663 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.118161.log.gz 2023-12-06T18:35:57.663 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143351.log 2023-12-06T18:35:57.663 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136562.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136562.log.gz 2023-12-06T18:35:57.663 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121690.log 2023-12-06T18:35:57.664 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151223.log.gz 2023-12-06T18:35:57.664 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.143351.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143351.log.gz 2023-12-06T18:35:57.664 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120811.log 2023-12-06T18:35:57.664 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150393.log 2023-12-06T18:35:57.664 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121690.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121690.log.gz 2023-12-06T18:35:57.664 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129552.log 2023-12-06T18:35:57.664 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120811.log.gz 2023-12-06T18:35:57.664 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150393.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150393.log.gz 2023-12-06T18:35:57.664 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124788.log 2023-12-06T18:35:57.665 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155473.log 2023-12-06T18:35:57.665 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129552.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129552.log.gz 2023-12-06T18:35:57.665 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134186.log 2023-12-06T18:35:57.665 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124788.log.gz 2023-12-06T18:35:57.665 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135250.log 2023-12-06T18:35:57.665 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155473.log.gz 2023-12-06T18:35:57.665 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143480.log 2023-12-06T18:35:57.665 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134186.log.gz 2023-12-06T18:35:57.665 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162782.log 2023-12-06T18:35:57.666 INFO:teuthology.orchestra.run.smithi123.stderr: 50.9% -- replaced with /var/log/ceph/ceph-client.admin.135250.log.gz 2023-12-06T18:35:57.666 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.143480.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143480.log.gz 2023-12-06T18:35:57.666 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119556.log 2023-12-06T18:35:57.666 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125366.log 2023-12-06T18:35:57.666 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162782.log.gz 2023-12-06T18:35:57.666 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119556.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.119556.log.gz 2023-12-06T18:35:57.666 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125366.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125366.log.gz 2023-12-06T18:35:57.666 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141085.log 2023-12-06T18:35:57.666 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123970.log 2023-12-06T18:35:57.667 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137342.log 2023-12-06T18:35:57.667 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141085.log.gz 2023-12-06T18:35:57.667 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123970.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.123970.log.gz-5 2023-12-06T18:35:57.667 INFO:teuthology.orchestra.run.smithi123.stderr:--verbose -- /var/log/ceph/ceph-client.admin.142878.log 2023-12-06T18:35:57.667 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155239.log 2023-12-06T18:35:57.667 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137342.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137342.log.gz 2023-12-06T18:35:57.667 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142096.log 2023-12-06T18:35:57.667 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142878.log.gz 2023-12-06T18:35:57.667 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157077.log 2023-12-06T18:35:57.667 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155239.log.gz 2023-12-06T18:35:57.668 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142096.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.135585.log 2023-12-06T18:35:57.668 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.142096.log.gz 2023-12-06T18:35:57.668 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132665.log 2023-12-06T18:35:57.668 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157077.log.gz 2023-12-06T18:35:57.668 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135585.log: 2.5%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.135585.log.gz--verbose 2023-12-06T18:35:57.668 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.117102.log 2023-12-06T18:35:57.668 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135862.log 2023-12-06T18:35:57.668 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132665.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132665.log.gz 2023-12-06T18:35:57.668 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.117102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121862.log 2023-12-06T18:35:57.668 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117102.log.gz 2023-12-06T18:35:57.669 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125128.log 2023-12-06T18:35:57.669 INFO:teuthology.orchestra.run.smithi123.stderr: 31.5% -- replaced with /var/log/ceph/ceph-client.admin.135862.log.gz 2023-12-06T18:35:57.669 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 /var/log/ceph/ceph-client.admin.121862.log: --verbose -- /var/log/ceph/ceph-client.admin.154984.log 2023-12-06T18:35:57.669 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121862.log.gz 2023-12-06T18:35:57.669 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119462.log 2023-12-06T18:35:57.669 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125128.log.gz 2023-12-06T18:35:57.669 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154984.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.144959.log -- replaced with /var/log/ceph/ceph-client.admin.154984.log.gz 2023-12-06T18:35:57.669 INFO:teuthology.orchestra.run.smithi123.stderr: 2023-12-06T18:35:57.669 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146806.log 2023-12-06T18:35:57.669 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119462.log.gz 2023-12-06T18:35:57.670 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.144959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131625.log 2023-12-06T18:35:57.670 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144959.log.gz 2023-12-06T18:35:57.670 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146806.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146806.log.gz 2023-12-06T18:35:57.670 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160876.log 2023-12-06T18:35:57.670 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134304.log 2023-12-06T18:35:57.670 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131625.log: 24.3% -- replaced with /var/log/ceph/ceph-client.admin.131625.log.gz 2023-12-06T18:35:57.670 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152402.log 2023-12-06T18:35:57.670 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160876.log.gz 2023-12-06T18:35:57.670 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134304.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134304.log.gz 2023-12-06T18:35:57.671 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119717.log 2023-12-06T18:35:57.671 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136200.log 2023-12-06T18:35:57.671 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152402.log.gz 2023-12-06T18:35:57.671 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119717.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119717.log.gz 2023-12-06T18:35:57.671 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137711.log 2023-12-06T18:35:57.671 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141450.log 2023-12-06T18:35:57.671 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136200.log: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.136200.log.gz 2023-12-06T18:35:57.671 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153391.log 2023-12-06T18:35:57.671 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137711.log.gz 2023-12-06T18:35:57.671 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141450.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141450.log.gz 2023-12-06T18:35:57.672 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138667.log 2023-12-06T18:35:57.672 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134746.log 2023-12-06T18:35:57.672 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153391.log.gz 2023-12-06T18:35:57.672 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140490.log 2023-12-06T18:35:57.672 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138667.log.gz 2023-12-06T18:35:57.672 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134746.log.gzgzip 2023-12-06T18:35:57.672 INFO:teuthology.orchestra.run.smithi123.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.139676.log 2023-12-06T18:35:57.672 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141967.log 2023-12-06T18:35:57.672 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140490.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140490.log.gz 2023-12-06T18:35:57.672 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161891.log 2023-12-06T18:35:57.673 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139676.log.gz 2023-12-06T18:35:57.673 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141967.log.gz 2023-12-06T18:35:57.673 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160994.log 2023-12-06T18:35:57.673 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148433.log 2023-12-06T18:35:57.673 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161891.log.gz 2023-12-06T18:35:57.673 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136933.log 2023-12-06T18:35:57.673 INFO:teuthology.orchestra.run.smithi123.stderr: 56.6% -- replaced with /var/log/ceph/ceph-client.admin.160994.log.gz 2023-12-06T18:35:57.673 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153927.log 2023-12-06T18:35:57.673 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148433.log.gz 2023-12-06T18:35:57.673 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158143.log 2023-12-06T18:35:57.674 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136933.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136933.log.gz 2023-12-06T18:35:57.674 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153927.log.gz 2023-12-06T18:35:57.674 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131751.log 2023-12-06T18:35:57.674 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145432.log 2023-12-06T18:35:57.674 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158143.log.gz 2023-12-06T18:35:57.674 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131751.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.138291.log 2023-12-06T18:35:57.674 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.131751.log.gz 2023-12-06T18:35:57.674 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130218.log 2023-12-06T18:35:57.675 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145432.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145432.log.gz 2023-12-06T18:35:57.675 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122398.log 2023-12-06T18:35:57.675 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138291.log.gz 2023-12-06T18:35:57.675 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130218.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.130218.log.gz-5 2023-12-06T18:35:57.675 INFO:teuthology.orchestra.run.smithi123.stderr:--verbose -- /var/log/ceph/ceph-client.admin.120077.log 2023-12-06T18:35:57.675 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155297.log 2023-12-06T18:35:57.675 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122398.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122398.log.gz 2023-12-06T18:35:57.675 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131415.log 2023-12-06T18:35:57.676 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120077.log.gz 2023-12-06T18:35:57.676 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129671.log 2023-12-06T18:35:57.676 INFO:teuthology.orchestra.run.smithi123.stderr: 57.1% -- replaced with /var/log/ceph/ceph-client.admin.155297.log.gz 2023-12-06T18:35:57.676 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119869.log 2023-12-06T18:35:57.676 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131415.log: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.131415.log.gz 2023-12-06T18:35:57.676 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129671.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129671.log.gz 2023-12-06T18:35:57.676 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118767.log 2023-12-06T18:35:57.676 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140069.log 2023-12-06T18:35:57.676 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119869.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119869.log.gz 2023-12-06T18:35:57.676 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.118767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146221.log 2023-12-06T18:35:57.677 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118767.log.gz 2023-12-06T18:35:57.677 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140069.log.gz 2023-12-06T18:35:57.677 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136804.log 2023-12-06T18:35:57.677 INFO:teuthology.orchestra.run.smithi123.stderr:gzip /var/log/ceph/ceph-client.admin.146221.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.140801.log 2023-12-06T18:35:57.677 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146221.log.gz 2023-12-06T18:35:57.677 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146198.log 2023-12-06T18:35:57.677 INFO:teuthology.orchestra.run.smithi123.stderr: 24.4% -- replaced with /var/log/ceph/ceph-client.admin.136804.log.gz 2023-12-06T18:35:57.677 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139767.log 2023-12-06T18:35:57.677 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.140801.log.gz 2023-12-06T18:35:57.678 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146849.log 2023-12-06T18:35:57.678 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146198.log.gz 2023-12-06T18:35:57.678 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139767.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.139767.log.gz 2023-12-06T18:35:57.678 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146849.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.146849.log.gz 2023-12-06T18:35:57.678 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131688.log 2023-12-06T18:35:57.678 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157713.log 2023-12-06T18:35:57.678 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151602.log 2023-12-06T18:35:57.678 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131688.log.gz 2023-12-06T18:35:57.678 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130869.log 2023-12-06T18:35:57.679 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157713.log.gz 2023-12-06T18:35:57.679 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137320.log 2023-12-06T18:35:57.679 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151602.log.gz 2023-12-06T18:35:57.679 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135742.log 2023-12-06T18:35:57.679 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130869.log.gz 2023-12-06T18:35:57.679 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125485.log 2023-12-06T18:35:57.679 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137320.log.gz 2023-12-06T18:35:57.679 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127690.log 2023-12-06T18:35:57.679 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135742.log.gz 2023-12-06T18:35:57.680 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125162.log 2023-12-06T18:35:57.680 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125485.log.gz 2023-12-06T18:35:57.680 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127690.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127690.log.gz 2023-12-06T18:35:57.680 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154922.log 2023-12-06T18:35:57.680 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136721.log 2023-12-06T18:35:57.680 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125162.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125162.log.gz 2023-12-06T18:35:57.680 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153680.log 2023-12-06T18:35:57.680 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154922.log.gz 2023-12-06T18:35:57.680 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160799.log 2023-12-06T18:35:57.681 INFO:teuthology.orchestra.run.smithi123.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.136721.log.gz 2023-12-06T18:35:57.681 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152251.log 2023-12-06T18:35:57.681 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153680.log.gz 2023-12-06T18:35:57.681 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125946.log 2023-12-06T18:35:57.681 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160799.log.gz 2023-12-06T18:35:57.681 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119408.log 2023-12-06T18:35:57.681 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152251.log.gz 2023-12-06T18:35:57.681 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118896.log 2023-12-06T18:35:57.681 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125946.log: 54.6% -- replaced with /var/log/ceph/ceph-client.admin.125946.log.gz 2023-12-06T18:35:57.682 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155414.log 2023-12-06T18:35:57.682 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119408.log.gz 2023-12-06T18:35:57.682 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.118896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119306.log 2023-12-06T18:35:57.682 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118896.log.gz 2023-12-06T18:35:57.682 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129093.log 2023-12-06T18:35:57.682 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155414.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155414.log.gz 2023-12-06T18:35:57.682 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122334.log 2023-12-06T18:35:57.682 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119306.log.gz 2023-12-06T18:35:57.682 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123669.log 2023-12-06T18:35:57.683 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129093.log.gz 2023-12-06T18:35:57.683 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142711.log 2023-12-06T18:35:57.683 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122334.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122334.log.gz 2023-12-06T18:35:57.683 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138098.log 2023-12-06T18:35:57.683 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123669.log.gz 2023-12-06T18:35:57.683 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142711.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.142711.log.gz--verbose 2023-12-06T18:35:57.683 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.162865.log 2023-12-06T18:35:57.683 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156837.log 2023-12-06T18:35:57.683 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138098.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138098.log.gz 2023-12-06T18:35:57.684 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120918.log 2023-12-06T18:35:57.684 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162865.log.gz 2023-12-06T18:35:57.684 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120424.log 2023-12-06T18:35:57.684 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156837.log.gz 2023-12-06T18:35:57.684 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138736.log 2023-12-06T18:35:57.684 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120918.log.gz 2023-12-06T18:35:57.684 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149069.log 2023-12-06T18:35:57.684 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120424.log.gz 2023-12-06T18:35:57.684 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138736.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.138736.log.gz/var/log/ceph/ceph-client.admin.134043.log 2023-12-06T18:35:57.685 INFO:teuthology.orchestra.run.smithi123.stderr: 2023-12-06T18:35:57.685 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118638.log 2023-12-06T18:35:57.685 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149069.log.gz 2023-12-06T18:35:57.685 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134043.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134043.log.gz 2023-12-06T18:35:57.685 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141859.log 2023-12-06T18:35:57.685 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125808.log 2023-12-06T18:35:57.685 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.118638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118638.log.gz 2023-12-06T18:35:57.685 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153659.log 2023-12-06T18:35:57.685 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141859.log.gz 2023-12-06T18:35:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151419.log 2023-12-06T18:35:57.686 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125808.log.gz 2023-12-06T18:35:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153659.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153659.log.gz 2023-12-06T18:35:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151419.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151419.log.gz 2023-12-06T18:35:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124295.log 2023-12-06T18:35:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121047.log 2023-12-06T18:35:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156656.log 2023-12-06T18:35:57.686 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124295.log.gz 2023-12-06T18:35:57.687 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139439.log 2023-12-06T18:35:57.687 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121047.log.gz 2023-12-06T18:35:57.687 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156383.log 2023-12-06T18:35:57.687 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156656.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156656.log.gz 2023-12-06T18:35:57.687 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161203.log 2023-12-06T18:35:57.687 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139439.log.gz 2023-12-06T18:35:57.687 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125638.log 2023-12-06T18:35:57.687 INFO:teuthology.orchestra.run.smithi123.stderr: 53.3% -- replaced with /var/log/ceph/ceph-client.admin.156383.log.gz 2023-12-06T18:35:57.687 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129586.log 2023-12-06T18:35:57.687 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161203.log.gz 2023-12-06T18:35:57.688 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143136.log 2023-12-06T18:35:57.688 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125638.log.gz 2023-12-06T18:35:57.688 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128651.log 2023-12-06T18:35:57.688 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129586.log.gz 2023-12-06T18:35:57.688 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.143136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125502.log 2023-12-06T18:35:57.688 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143136.log.gz 2023-12-06T18:35:57.688 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128651.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128651.log.gz 2023-12-06T18:35:57.688 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156344.log 2023-12-06T18:35:57.688 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119445.log 2023-12-06T18:35:57.689 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125502.log.gz 2023-12-06T18:35:57.689 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162245.log 2023-12-06T18:35:57.689 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156344.log.gz 2023-12-06T18:35:57.689 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130533.log 2023-12-06T18:35:57.689 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.119445.log.gz 2023-12-06T18:35:57.689 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161138.log 2023-12-06T18:35:57.689 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162245.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162245.log.gz 2023-12-06T18:35:57.689 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157520.log 2023-12-06T18:35:57.689 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130533.log.gz 2023-12-06T18:35:57.690 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161138.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.161138.log.gz--verbose 2023-12-06T18:35:57.690 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.120746.log 2023-12-06T18:35:57.690 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151825.log 2023-12-06T18:35:57.690 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157520.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157520.log.gz 2023-12-06T18:35:57.690 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133001.log 2023-12-06T18:35:57.690 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120746.log.gz 2023-12-06T18:35:57.690 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135270.log 2023-12-06T18:35:57.690 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151825.log.gz 2023-12-06T18:35:57.690 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137818.log 2023-12-06T18:35:57.691 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133001.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133001.log.gz 2023-12-06T18:35:57.691 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134917.log 2023-12-06T18:35:57.691 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135270.log.gz 2023-12-06T18:35:57.691 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137818.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.137818.log.gz-- 2023-12-06T18:35:57.691 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140780.log 2023-12-06T18:35:57.691 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146074.log 2023-12-06T18:35:57.691 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134917.log.gz 2023-12-06T18:35:57.691 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140780.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140780.log.gz 2023-12-06T18:35:57.691 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152122.log 2023-12-06T18:35:57.692 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146074.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146074.log.gz 2023-12-06T18:35:57.692 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135622.log 2023-12-06T18:35:57.692 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152122.log.gz 2023-12-06T18:35:57.692 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135804.log 2023-12-06T18:35:57.692 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146342.log 2023-12-06T18:35:57.692 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135622.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135622.log.gz 2023-12-06T18:35:57.692 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138649.log 2023-12-06T18:35:57.692 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135804.log.gz 2023-12-06T18:35:57.692 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159316.log 2023-12-06T18:35:57.692 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146342.log.gz 2023-12-06T18:35:57.693 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142731.log 2023-12-06T18:35:57.693 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138649.log.gz 2023-12-06T18:35:57.693 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139332.log 2023-12-06T18:35:57.693 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159316.log.gz 2023-12-06T18:35:57.693 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142731.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.132780.log -- replaced with /var/log/ceph/ceph-client.admin.142731.log.gz 2023-12-06T18:35:57.693 INFO:teuthology.orchestra.run.smithi123.stderr: 2023-12-06T18:35:57.693 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119598.log 2023-12-06T18:35:57.693 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139332.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139332.log.gz 2023-12-06T18:35:57.693 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150092.log 2023-12-06T18:35:57.694 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132780.log.gz 2023-12-06T18:35:57.694 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119598.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.119598.log.gz/var/log/ceph/ceph-client.admin.130470.log 2023-12-06T18:35:57.694 INFO:teuthology.orchestra.run.smithi123.stderr: 2023-12-06T18:35:57.694 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134982.log 2023-12-06T18:35:57.694 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150092.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150092.log.gz 2023-12-06T18:35:57.694 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155553.log 2023-12-06T18:35:57.694 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130470.log.gz 2023-12-06T18:35:57.694 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159338.log 2023-12-06T18:35:57.694 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134982.log.gz 2023-12-06T18:35:57.695 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147538.log 2023-12-06T18:35:57.695 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155553.log.gz 2023-12-06T18:35:57.695 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120235.log 2023-12-06T18:35:57.695 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159338.log.gz 2023-12-06T18:35:57.695 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136101.log 2023-12-06T18:35:57.695 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147538.log.gz 2023-12-06T18:35:57.695 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149681.log 2023-12-06T18:35:57.695 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120235.log.gz 2023-12-06T18:35:57.695 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119241.log 2023-12-06T18:35:57.696 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136101.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136101.log.gz 2023-12-06T18:35:57.696 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125298.log 2023-12-06T18:35:57.696 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149681.log.gz 2023-12-06T18:35:57.696 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119241.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119241.log.gz 2023-12-06T18:35:57.696 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151362.log 2023-12-06T18:35:57.696 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157627.log 2023-12-06T18:35:57.696 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125298.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125298.log.gz 2023-12-06T18:35:57.696 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151362.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.151362.log.gz--verbose 2023-12-06T18:35:57.696 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.158951.log 2023-12-06T18:35:57.696 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128940.log 2023-12-06T18:35:57.697 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157627.log.gz 2023-12-06T18:35:57.697 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152660.log 2023-12-06T18:35:57.697 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158951.log.gz 2023-12-06T18:35:57.697 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150672.log 2023-12-06T18:35:57.697 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128940.log.gz 2023-12-06T18:35:57.697 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162052.log 2023-12-06T18:35:57.697 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152660.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152660.log.gz 2023-12-06T18:35:57.697 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150672.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150672.log.gz 2023-12-06T18:35:57.697 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162052.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162052.log.gz 2023-12-06T18:35:57.698 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149284.log 2023-12-06T18:35:57.698 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158057.log 2023-12-06T18:35:57.698 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120789.log 2023-12-06T18:35:57.698 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149284.log.gz 2023-12-06T18:35:57.698 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119831.log 2023-12-06T18:35:57.698 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158057.log.gz 2023-12-06T18:35:57.698 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154086.log 2023-12-06T18:35:57.698 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120789.log.gz 2023-12-06T18:35:57.698 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136520.log 2023-12-06T18:35:57.699 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119831.log.gz 2023-12-06T18:35:57.699 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154086.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.154086.log.gz--verbose 2023-12-06T18:35:57.699 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.123048.log 2023-12-06T18:35:57.699 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141795.log 2023-12-06T18:35:57.699 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136520.log.gz 2023-12-06T18:35:57.699 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126990.log 2023-12-06T18:35:57.699 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123048.log.gz 2023-12-06T18:35:57.699 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141795.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141795.log.gz 2023-12-06T18:35:57.699 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126990.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126990.log.gz 2023-12-06T18:35:57.700 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148286.log 2023-12-06T18:35:57.700 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137883.log 2023-12-06T18:35:57.700 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153133.log 2023-12-06T18:35:57.700 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148286.log.gz 2023-12-06T18:35:57.700 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160423.log 2023-12-06T18:35:57.700 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137883.log.gz 2023-12-06T18:35:57.700 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.153133.log: -- /var/log/ceph/ceph-client.admin.124703.log 2023-12-06T18:35:57.700 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153133.log.gz 2023-12-06T18:35:57.700 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160423.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.136023.log 2023-12-06T18:35:57.701 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.160423.log.gz 2023-12-06T18:35:57.701 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153433.log 2023-12-06T18:35:57.701 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124703.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.124703.log.gz 2023-12-06T18:35:57.701 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125213.log 2023-12-06T18:35:57.701 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136023.log.gz 2023-12-06T18:35:57.701 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153433.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153433.log.gz 2023-12-06T18:35:57.701 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124720.log 2023-12-06T18:35:57.701 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131457.log 2023-12-06T18:35:57.701 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125213.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125213.log.gz 2023-12-06T18:35:57.702 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162675.log 2023-12-06T18:35:57.702 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124720.log.gz 2023-12-06T18:35:57.702 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149577.log 2023-12-06T18:35:57.702 INFO:teuthology.orchestra.run.smithi123.stderr: 24.3% -- replaced with /var/log/ceph/ceph-client.admin.131457.log.gz 2023-12-06T18:35:57.702 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127310.log 2023-12-06T18:35:57.702 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162675.log.gz 2023-12-06T18:35:57.702 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120359.log 2023-12-06T18:35:57.702 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149577.log.gz 2023-12-06T18:35:57.702 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127310.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.127310.log.gz 2023-12-06T18:35:57.703 INFO:teuthology.orchestra.run.smithi123.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.136998.log 2023-12-06T18:35:57.703 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132626.log 2023-12-06T18:35:57.703 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120359.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120359.log.gz 2023-12-06T18:35:57.703 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151399.log 2023-12-06T18:35:57.703 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136998.log.gz 2023-12-06T18:35:57.703 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123518.log 2023-12-06T18:35:57.703 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132626.log.gz 2023-12-06T18:35:57.703 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154842.log 2023-12-06T18:35:57.703 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151399.log.gz 2023-12-06T18:35:57.704 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134266.log 2023-12-06T18:35:57.704 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123518.log.gz 2023-12-06T18:35:57.704 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138438.log 2023-12-06T18:35:57.704 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154842.log.gz 2023-12-06T18:35:57.704 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 /var/log/ceph/ceph-client.admin.134266.log: --verbose -- /var/log/ceph/ceph-client.admin.130197.log 2023-12-06T18:35:57.704 INFO:teuthology.orchestra.run.smithi123.stderr: 22.4% -- replaced with /var/log/ceph/ceph-client.admin.134266.log.gz 2023-12-06T18:35:57.704 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145131.log 2023-12-06T18:35:57.704 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138438.log.gz 2023-12-06T18:35:57.704 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130197.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130197.log.gz 2023-12-06T18:35:57.705 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123819.log 2023-12-06T18:35:57.705 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135722.log 2023-12-06T18:35:57.705 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145131.log.gz 2023-12-06T18:35:57.705 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154708.log 2023-12-06T18:35:57.705 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123819.log.gz 2023-12-06T18:35:57.705 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121368.log 2023-12-06T18:35:57.705 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135722.log.gz 2023-12-06T18:35:57.705 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153452.log 2023-12-06T18:35:57.705 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154708.log.gz 2023-12-06T18:35:57.706 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151323.log 2023-12-06T18:35:57.706 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121368.log.gz 2023-12-06T18:35:57.706 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153452.log.gz 2023-12-06T18:35:57.706 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128889.log 2023-12-06T18:35:57.706 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162882.log 2023-12-06T18:35:57.706 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151323.log: 11.6% -- replaced with /var/log/ceph/ceph-client.admin.151323.log.gz 2023-12-06T18:35:57.706 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127570.log 2023-12-06T18:35:57.706 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128889.log.gz 2023-12-06T18:35:57.706 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162882.log.gz 2023-12-06T18:35:57.707 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127570.log.gz 2023-12-06T18:35:57.707 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152832.log 2023-12-06T18:35:57.707 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125264.log 2023-12-06T18:35:57.707 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146156.log 2023-12-06T18:35:57.707 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152832.log.gz 2023-12-06T18:35:57.707 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125179.log 2023-12-06T18:35:57.707 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125264.log.gz 2023-12-06T18:35:57.707 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166092.log 2023-12-06T18:35:57.707 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146156.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146156.log.gz 2023-12-06T18:35:57.707 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135397.log 2023-12-06T18:35:57.708 INFO:teuthology.orchestra.run.smithi123.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.125179.log.gz 2023-12-06T18:35:57.708 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.166092.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166092.log.gzgzip 2023-12-06T18:35:57.708 INFO:teuthology.orchestra.run.smithi123.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.130554.log 2023-12-06T18:35:57.708 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125060.log 2023-12-06T18:35:57.708 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135397.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135397.log.gz 2023-12-06T18:35:57.708 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142268.log 2023-12-06T18:35:57.708 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130554.log.gz 2023-12-06T18:35:57.708 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146490.log 2023-12-06T18:35:57.708 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125060.log.gz 2023-12-06T18:35:57.709 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137904.log 2023-12-06T18:35:57.709 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142268.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142268.log.gz 2023-12-06T18:35:57.709 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146490.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.146490.log.gz 2023-12-06T18:35:57.709 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150027.log 2023-12-06T18:35:57.709 INFO:teuthology.orchestra.run.smithi123.stderr:gzip /var/log/ceph/ceph-client.admin.137904.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.124119.log 2023-12-06T18:35:57.709 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137904.log.gz 2023-12-06T18:35:57.709 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150027.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.150027.log.gz-- 2023-12-06T18:35:57.709 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157158.log 2023-12-06T18:35:57.709 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124431.log 2023-12-06T18:35:57.710 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124119.log.gz 2023-12-06T18:35:57.710 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157158.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-12-06T18:35:57.710 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157158.log.gz 2023-12-06T18:35:57.710 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128328.log 2023-12-06T18:35:57.710 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124431.log.gz 2023-12-06T18:35:57.710 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157330.log 2023-12-06T18:35:57.710 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.128328.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128328.log.gz 2023-12-06T18:35:57.710 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157330.log.gz 2023-12-06T18:35:57.710 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154488.log 2023-12-06T18:35:57.711 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159402.log 2023-12-06T18:35:57.711 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145972.log 2023-12-06T18:35:57.711 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154488.log.gz 2023-12-06T18:35:57.711 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142899.log 2023-12-06T18:35:57.711 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159402.log.gz 2023-12-06T18:35:57.711 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145972.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145972.log.gz 2023-12-06T18:35:57.711 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142899.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142899.log.gz 2023-12-06T18:35:57.711 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125706.log 2023-12-06T18:35:57.711 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137625.log 2023-12-06T18:35:57.712 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156243.log 2023-12-06T18:35:57.712 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125706.log.gz 2023-12-06T18:35:57.712 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162374.log 2023-12-06T18:35:57.712 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137625.log.gz 2023-12-06T18:35:57.712 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145475.log 2023-12-06T18:35:57.712 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156243.log.gz 2023-12-06T18:35:57.712 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119907.log 2023-12-06T18:35:57.712 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162374.log.gz 2023-12-06T18:35:57.712 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153262.log 2023-12-06T18:35:57.713 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145475.log.gz 2023-12-06T18:35:57.713 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138701.log 2023-12-06T18:35:57.713 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119907.log.gz 2023-12-06T18:35:57.713 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155593.log 2023-12-06T18:35:57.713 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153262.log.gz 2023-12-06T18:35:57.713 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137775.log 2023-12-06T18:35:57.713 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138701.log.gz 2023-12-06T18:35:57.713 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132722.log 2023-12-06T18:35:57.713 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155593.log.gz 2023-12-06T18:35:57.714 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137775.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137775.log.gz 2023-12-06T18:35:57.714 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132722.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132722.log.gz 2023-12-06T18:35:57.714 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127670.log 2023-12-06T18:35:57.714 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158843.log 2023-12-06T18:35:57.714 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127670.log.gz 2023-12-06T18:35:57.714 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153524.log 2023-12-06T18:35:57.714 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151788.log 24.3% 2023-12-06T18:35:57.714 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.158843.log.gz 2023-12-06T18:35:57.715 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124363.log 2023-12-06T18:35:57.715 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153524.log.gz 2023-12-06T18:35:57.715 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151538.log 2023-12-06T18:35:57.715 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151788.log.gz 2023-12-06T18:35:57.715 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144830.log 2023-12-06T18:35:57.715 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124363.log.gz 2023-12-06T18:35:57.715 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126030.log 2023-12-06T18:35:57.715 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151538.log.gz 2023-12-06T18:35:57.715 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.144830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134627.log 2023-12-06T18:35:57.715 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144830.log.gz 2023-12-06T18:35:57.716 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137105.log 2023-12-06T18:35:57.716 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126030.log.gz 2023-12-06T18:35:57.716 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141150.log 2023-12-06T18:35:57.716 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134627.log.gz 2023-12-06T18:35:57.716 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156086.log 2023-12-06T18:35:57.716 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137105.log.gz 2023-12-06T18:35:57.716 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126230.log 2023-12-06T18:35:57.716 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141150.log.gz 2023-12-06T18:35:57.716 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123149.log 2023-12-06T18:35:57.717 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156086.log.gz 2023-12-06T18:35:57.717 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162916.log 2023-12-06T18:35:57.717 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126230.log.gz 2023-12-06T18:35:57.717 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135903.log 2023-12-06T18:35:57.717 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123149.log.gz 2023-12-06T18:35:57.717 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129365.log 2023-12-06T18:35:57.717 INFO:teuthology.orchestra.run.smithi123.stderr: 10.9% -- replaced with /var/log/ceph/ceph-client.admin.162916.log.gz 2023-12-06T18:35:57.717 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147968.log 2023-12-06T18:35:57.717 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135903.log.gz 2023-12-06T18:35:57.718 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130659.log 2023-12-06T18:35:57.718 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129365.log.gz 2023-12-06T18:35:57.718 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119048.log 2023-12-06T18:35:57.718 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147968.log.gz 2023-12-06T18:35:57.718 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159682.log 2023-12-06T18:35:57.718 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130659.log.gz 2023-12-06T18:35:57.718 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119048.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119048.log.gz 2023-12-06T18:35:57.718 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159682.log.gz 2023-12-06T18:35:57.719 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132116.log 2023-12-06T18:35:57.719 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146589.log 2023-12-06T18:35:57.719 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132116.log.gz 2023-12-06T18:35:57.719 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146589.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146589.log.gz 2023-12-06T18:35:57.719 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121840.log 2023-12-06T18:35:57.719 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135125.log 2023-12-06T18:35:57.719 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160856.log 2023-12-06T18:35:57.719 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121840.log.gz 2023-12-06T18:35:57.719 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120115.log 2023-12-06T18:35:57.720 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135125.log.gz 2023-12-06T18:35:57.720 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160856.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160856.log.gz 2023-12-06T18:35:57.720 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120115.log.gz 2023-12-06T18:35:57.720 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135783.log 2023-12-06T18:35:57.720 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141407.log 2023-12-06T18:35:57.720 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150931.log 2023-12-06T18:35:57.720 INFO:teuthology.orchestra.run.smithi123.stderr: 22.9% -- replaced with /var/log/ceph/ceph-client.admin.135783.log.gz 2023-12-06T18:35:57.720 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150242.log /var/log/ceph/ceph-client.admin.141407.log: 2023-12-06T18:35:57.720 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141407.log.gz 2023-12-06T18:35:57.721 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148599.log 0.0% 2023-12-06T18:35:57.721 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.150931.log.gz 2023-12-06T18:35:57.721 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155989.log 2023-12-06T18:35:57.721 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150242.log.gz 2023-12-06T18:35:57.721 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148599.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148599.log.gz 2023-12-06T18:35:57.721 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155989.log.gz 2023-12-06T18:35:57.721 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158346.log 2023-12-06T18:35:57.721 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134585.log 2023-12-06T18:35:57.721 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158346.log.gz 2023-12-06T18:35:57.722 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133366.log 2023-12-06T18:35:57.722 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133856.log 2023-12-06T18:35:57.722 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134585.log.gz 2023-12-06T18:35:57.722 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157864.log 2023-12-06T18:35:57.722 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133366.log.gz 2023-12-06T18:35:57.722 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136341.log 2023-12-06T18:35:57.722 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133856.log.gz 2023-12-06T18:35:57.722 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158429.log 2023-12-06T18:35:57.722 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157864.log.gz 2023-12-06T18:35:57.723 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155122.log 2023-12-06T18:35:57.723 INFO:teuthology.orchestra.run.smithi123.stderr: 24.3% -- replaced with /var/log/ceph/ceph-client.admin.136341.log.gz 2023-12-06T18:35:57.723 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125587.log 2023-12-06T18:35:57.723 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158429.log.gz 2023-12-06T18:35:57.723 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121518.log 2023-12-06T18:35:57.723 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155122.log.gz 2023-12-06T18:35:57.723 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 /var/log/ceph/ceph-client.admin.125587.log: --verbose -- /var/log/ceph/ceph-client.admin.139396.log 2023-12-06T18:35:57.723 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125587.log.gz 2023-12-06T18:35:57.723 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121518.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121518.log.gz 2023-12-06T18:35:57.724 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139396.log.gz 2023-12-06T18:35:57.724 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126570.log 2023-12-06T18:35:57.724 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150949.log 2023-12-06T18:35:57.724 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120940.log 2023-12-06T18:35:57.724 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126570.log.gz 2023-12-06T18:35:57.724 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150949.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150949.log.gz 2023-12-06T18:35:57.724 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120940.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120940.log.gz 2023-12-06T18:35:57.724 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144938.log 2023-12-06T18:35:57.724 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155140.log 2023-12-06T18:35:57.725 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.144938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151204.log 2023-12-06T18:35:57.725 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144938.log.gz 2023-12-06T18:35:57.725 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145931.log 2023-12-06T18:35:57.725 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155140.log.gz 2023-12-06T18:35:57.725 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151204.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151204.log.gz 2023-12-06T18:35:57.725 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145931.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145931.log.gz 2023-12-06T18:35:57.725 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120021.log 2023-12-06T18:35:57.725 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120215.log 2023-12-06T18:35:57.725 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120021.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.120021.log.gz/var/log/ceph/ceph-client.admin.125893.log 2023-12-06T18:35:57.725 INFO:teuthology.orchestra.run.smithi123.stderr: 2023-12-06T18:35:57.726 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151341.log 2023-12-06T18:35:57.726 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120215.log.gz 2023-12-06T18:35:57.726 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160570.log 2023-12-06T18:35:57.726 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125893.log.gz 2023-12-06T18:35:57.726 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122205.log 2023-12-06T18:35:57.726 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151341.log.gz 2023-12-06T18:35:57.726 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143243.log 2023-12-06T18:35:57.726 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160570.log.gz 2023-12-06T18:35:57.726 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124754.log 2023-12-06T18:35:57.727 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122205.log.gz 2023-12-06T18:35:57.727 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.143243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149155.log 2023-12-06T18:35:57.727 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143243.log.gz 2023-12-06T18:35:57.727 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156499.log 2023-12-06T18:35:57.727 INFO:teuthology.orchestra.run.smithi123.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.124754.log.gz 2023-12-06T18:35:57.727 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152165.log 2023-12-06T18:35:57.727 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149155.log.gz 2023-12-06T18:35:57.727 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156499.log.gz 2023-12-06T18:35:57.727 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146012.log 2023-12-06T18:35:57.728 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129654.log 2023-12-06T18:35:57.728 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152165.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152165.log.gz 2023-12-06T18:35:57.728 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146012.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146012.log.gz 2023-12-06T18:35:57.728 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136483.log 2023-12-06T18:35:57.728 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129654.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129654.log.gz 2023-12-06T18:35:57.728 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150221.log 2023-12-06T18:35:57.728 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140838.log 2023-12-06T18:35:57.728 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136483.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136483.log.gz 2023-12-06T18:35:57.728 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137578.log 2023-12-06T18:35:57.729 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150221.log.gz 2023-12-06T18:35:57.729 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140838.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140838.log.gz 2023-12-06T18:35:57.729 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137578.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137578.log.gz 2023-12-06T18:35:57.729 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121990.log 2023-12-06T18:35:57.729 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142160.log 2023-12-06T18:35:57.729 INFO:teuthology.orchestra.run.smithi123.stderr:gzip /var/log/ceph/ceph-client.admin.121990.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.141752.log 2023-12-06T18:35:57.729 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121990.log.gz 2023-12-06T18:35:57.729 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142160.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142160.log.gz 2023-12-06T18:35:57.729 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141752.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141752.log.gz 2023-12-06T18:35:57.730 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139907.log 2023-12-06T18:35:57.730 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122291.log 2023-12-06T18:35:57.730 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139907.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139907.log.gz 2023-12-06T18:35:57.730 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122291.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122291.log.gz 2023-12-06T18:35:57.730 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154451.log 2023-12-06T18:35:57.730 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161676.log 2023-12-06T18:35:57.730 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147861.log 2023-12-06T18:35:57.730 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154451.log.gz 2023-12-06T18:35:57.731 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151682.log 2023-12-06T18:35:57.731 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161676.log.gz 2023-12-06T18:35:57.731 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157498.log 2023-12-06T18:35:57.731 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147861.log.gz 2023-12-06T18:35:57.731 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162933.log 2023-12-06T18:35:57.731 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151682.log.gz 2023-12-06T18:35:57.731 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130491.log 2023-12-06T18:35:57.731 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157498.log.gz 2023-12-06T18:35:57.731 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162933.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162933.log.gz 2023-12-06T18:35:57.732 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130491.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130491.log.gz 2023-12-06T18:35:57.732 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121754.log 2023-12-06T18:35:57.732 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139847.log 2023-12-06T18:35:57.732 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121754.log.gz 2023-12-06T18:35:57.732 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122119.log 2023-12-06T18:35:57.732 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137990.log 2023-12-06T18:35:57.732 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139847.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139847.log.gz 2023-12-06T18:35:57.732 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136043.log 2023-12-06T18:35:57.732 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122119.log.gz 2023-12-06T18:35:57.733 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145196.log 2023-12-06T18:35:57.733 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137990.log.gz 2023-12-06T18:35:57.733 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132245.log 2023-12-06T18:35:57.733 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136043.log.gz 2023-12-06T18:35:57.733 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145196.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145196.log.gz 2023-12-06T18:35:57.733 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132245.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132245.log.gz 2023-12-06T18:35:57.733 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142628.log 2023-12-06T18:35:57.733 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154320.log 2023-12-06T18:35:57.733 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142628.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142628.log.gz 2023-12-06T18:35:57.734 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154320.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154320.log.gz 2023-12-06T18:35:57.734 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134466.log 2023-12-06T18:35:57.734 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138012.log 2023-12-06T18:35:57.734 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160836.log 2023-12-06T18:35:57.734 INFO:teuthology.orchestra.run.smithi123.stderr: 56.8% -- replaced with /var/log/ceph/ceph-client.admin.134466.log.gz 2023-12-06T18:35:57.734 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128787.log 2023-12-06T18:35:57.734 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138012.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138012.log.gz 2023-12-06T18:35:57.734 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160836.log.gz 2023-12-06T18:35:57.735 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128787.log.gz 2023-12-06T18:35:57.735 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126310.log 2023-12-06T18:35:57.735 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151458.log 2023-12-06T18:35:57.735 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121111.log 2023-12-06T18:35:57.735 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126310.log.gz 2023-12-06T18:35:57.735 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132646.log 2023-12-06T18:35:57.735 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151458.log.gz 2023-12-06T18:35:57.735 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147344.log 2023-12-06T18:35:57.735 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.121111.log.gz 2023-12-06T18:35:57.736 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157541.log 2023-12-06T18:35:57.736 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132646.log.gz 2023-12-06T18:35:57.736 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118983.log 2023-12-06T18:35:57.736 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147344.log.gz 2023-12-06T18:35:57.736 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125519.log 2023-12-06T18:35:57.736 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157541.log.gz 2023-12-06T18:35:57.736 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.118983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137213.log 2023-12-06T18:35:57.736 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118983.log.gz 2023-12-06T18:35:57.736 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147581.log 2023-12-06T18:35:57.737 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125519.log.gz 2023-12-06T18:35:57.737 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149739.log 2023-12-06T18:35:57.737 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137213.log.gz 2023-12-06T18:35:57.737 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128277.log 2023-12-06T18:35:57.737 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147581.log.gz 2023-12-06T18:35:57.737 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149739.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.149739.log.gz--verbose 2023-12-06T18:35:57.737 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.139310.log 2023-12-06T18:35:57.737 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136321.log 2023-12-06T18:35:57.737 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128277.log.gz 2023-12-06T18:35:57.738 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139310.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139310.log.gz 2023-12-06T18:35:57.824 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136321.log: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.136321.log.gz 2023-12-06T18:35:57.824 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162223.log 2023-12-06T18:35:57.824 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146053.log 2023-12-06T18:35:57.824 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162223.log.gz 2023-12-06T18:35:57.825 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146053.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146053.log.gz 2023-12-06T18:35:57.825 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127230.log 2023-12-06T18:35:57.825 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148306.log 2023-12-06T18:35:57.825 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127230.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.127230.log.gz--verbose 2023-12-06T18:35:57.825 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.134321.log 2023-12-06T18:35:57.825 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131079.log 2023-12-06T18:35:57.825 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148306.log.gz 2023-12-06T18:35:57.825 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147689.log 2023-12-06T18:35:57.825 INFO:teuthology.orchestra.run.smithi123.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.134321.log.gz 2023-12-06T18:35:57.826 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131079.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131079.log.gz 2023-12-06T18:35:57.826 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150889.log 2023-12-06T18:35:57.826 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117965.log 2023-12-06T18:35:57.826 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147689.log.gz 2023-12-06T18:35:57.826 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156263.log 2023-12-06T18:35:57.826 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150889.log.gz 2023-12-06T18:35:57.826 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.117965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149898.log 2023-12-06T18:35:57.826 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117965.log.gz 2023-12-06T18:35:57.827 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157950.log 2023-12-06T18:35:57.829 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156263.log.gz 2023-12-06T18:35:57.829 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149898.log: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.149898.log.gz 2023-12-06T18:35:57.829 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157950.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157950.log.gz 2023-12-06T18:35:57.829 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157252.log 2023-12-06T18:35:57.829 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130239.log 2023-12-06T18:35:57.829 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142053.log 2023-12-06T18:35:57.830 INFO:teuthology.orchestra.run.smithi123.stderr: 55.5% -- replaced with /var/log/ceph/ceph-client.admin.157252.log.gz 2023-12-06T18:35:57.830 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 /var/log/ceph/ceph-client.admin.130239.log: --verbose -- /var/log/ceph/ceph-client.admin.127830.log 2023-12-06T18:35:57.830 INFO:teuthology.orchestra.run.smithi123.stderr: 24.7% -- replaced with /var/log/ceph/ceph-client.admin.130239.log.gz 2023-12-06T18:35:57.830 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142053.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142053.log.gz 2023-12-06T18:35:57.830 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127190.log 2023-12-06T18:35:57.830 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152101.log 2023-12-06T18:35:57.830 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127830.log.gz 2023-12-06T18:35:57.830 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127190.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127190.log.gz 2023-12-06T18:35:57.830 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152101.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152101.log.gz 2023-12-06T18:35:57.831 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130344.log 2023-12-06T18:35:57.831 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122226.log 2023-12-06T18:35:57.831 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130344.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.124924.log -- replaced with /var/log/ceph/ceph-client.admin.130344.log.gz 2023-12-06T18:35:57.831 INFO:teuthology.orchestra.run.smithi123.stderr: 2023-12-06T18:35:57.831 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117522.log 2023-12-06T18:35:57.831 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122226.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122226.log.gz 2023-12-06T18:35:57.831 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124924.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124924.log.gz 2023-12-06T18:35:57.831 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162352.log 2023-12-06T18:35:57.831 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.117522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117522.log.gz 2023-12-06T18:35:57.832 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161181.log 2023-12-06T18:35:57.832 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151972.log 2023-12-06T18:35:57.832 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162352.log.gz 2023-12-06T18:35:57.832 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161181.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161181.log.gz 2023-12-06T18:35:57.832 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151972.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151972.log.gz 2023-12-06T18:35:57.832 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156540.log 2023-12-06T18:35:57.832 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142564.log 2023-12-06T18:35:57.832 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156540.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156540.log.gz 2023-12-06T18:35:57.832 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141643.log 2023-12-06T18:35:57.833 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139246.log 2023-12-06T18:35:57.833 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142564.log.gz 2023-12-06T18:35:57.833 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129840.log 2023-12-06T18:35:57.833 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141643.log.gz 2023-12-06T18:35:57.833 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143394.log 2023-12-06T18:35:57.833 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139246.log.gz 2023-12-06T18:35:57.833 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142010.log 2023-12-06T18:35:57.833 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129840.log.gz 2023-12-06T18:35:57.833 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.143394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143394.log.gz 2023-12-06T18:35:57.834 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129042.log 2023-12-06T18:35:57.834 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142010.log: /var/log/ceph/ceph-client.admin.130302.log 2023-12-06T18:35:57.834 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142010.log.gz 2023-12-06T18:35:57.834 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129382.log 2023-12-06T18:35:57.834 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129042.log.gz 2023-12-06T18:35:57.834 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120171.log 2023-12-06T18:35:57.834 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130302.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130302.log.gz 2023-12-06T18:35:57.834 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145024.log 2023-12-06T18:35:57.834 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129382.log.gz 2023-12-06T18:35:57.834 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128056.log 2023-12-06T18:35:57.835 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120171.log.gz 2023-12-06T18:35:57.835 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134896.log 2023-12-06T18:35:57.835 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145024.log.gz 2023-12-06T18:35:57.835 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161396.log 2023-12-06T18:35:57.835 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128056.log.gz 2023-12-06T18:35:57.835 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137170.log 2023-12-06T18:35:57.835 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134896.log.gz 2023-12-06T18:35:57.835 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154160.log 2023-12-06T18:35:57.835 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161396.log.gz 2023-12-06T18:35:57.836 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137170.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137170.log.gz 2023-12-06T18:35:57.836 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157563.log 2023-12-06T18:35:57.836 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157907.log 2023-12-06T18:35:57.836 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154160.log.gz 2023-12-06T18:35:57.836 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131373.log 2023-12-06T18:35:57.836 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157563.log.gz 2023-12-06T18:35:57.836 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138356.log 2023-12-06T18:35:57.836 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157907.log.gz 2023-12-06T18:35:57.836 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162739.log 2023-12-06T18:35:57.837 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131373.log.gz 2023-12-06T18:35:57.837 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133960.log 2023-12-06T18:35:57.837 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138356.log.gz 2023-12-06T18:35:57.837 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132073.log 2023-12-06T18:35:57.837 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162739.log.gz 2023-12-06T18:35:57.837 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157037.log 2023-12-06T18:35:57.837 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133960.log.gz 2023-12-06T18:35:57.837 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119849.log 2023-12-06T18:35:57.837 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132073.log.gz 2023-12-06T18:35:57.838 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159574.log 2023-12-06T18:35:57.838 INFO:teuthology.orchestra.run.smithi123.stderr: 55.3% -- replaced with /var/log/ceph/ceph-client.admin.157037.log.gz 2023-12-06T18:35:57.838 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123991.log 2023-12-06T18:35:57.838 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.119849.log.gz 2023-12-06T18:35:57.838 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141428.log 2023-12-06T18:35:57.838 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159574.log.gz 2023-12-06T18:35:57.838 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123991.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123991.log.gz 2023-12-06T18:35:57.838 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141428.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141428.log.gz 2023-12-06T18:35:57.838 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120854.log 2023-12-06T18:35:57.839 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152617.log 2023-12-06T18:35:57.839 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120854.log.gz 2023-12-06T18:35:57.839 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143222.log 2023-12-06T18:35:57.839 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161482.log 2023-12-06T18:35:57.839 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152617.log.gz 2023-12-06T18:35:57.839 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.143222.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143222.log.gz 2023-12-06T18:35:57.839 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161482.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161482.log.gz 2023-12-06T18:35:57.839 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134605.log 2023-12-06T18:35:57.839 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124184.log 2023-12-06T18:35:57.840 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158164.log 2023-12-06T18:35:57.840 INFO:teuthology.orchestra.run.smithi123.stderr: 8.3% -- replaced with /var/log/ceph/ceph-client.admin.134605.log.gz 2023-12-06T18:35:57.840 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159015.log 2023-12-06T18:35:57.840 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124184.log.gz 2023-12-06T18:35:57.840 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158164.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.158164.log.gz-- 2023-12-06T18:35:57.840 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155374.log 2023-12-06T18:35:57.840 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157842.log 2023-12-06T18:35:57.840 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159015.log.gz 2023-12-06T18:35:57.840 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155374.log.gz 2023-12-06T18:35:57.841 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157842.log.gz 2023-12-06T18:35:57.841 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152488.log 2023-12-06T18:35:57.841 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148642.log 2023-12-06T18:35:57.841 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144981.log 2023-12-06T18:35:57.841 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152488.log.gz 2023-12-06T18:35:57.841 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118545.log 2023-12-06T18:35:57.841 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148642.log.gz 2023-12-06T18:35:57.841 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.144981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144981.log.gz 2023-12-06T18:35:57.841 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.118545.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118545.log.gz 2023-12-06T18:35:57.842 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123626.log 2023-12-06T18:35:57.842 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127870.log 2023-12-06T18:35:57.842 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123626.log.gz 2023-12-06T18:35:57.842 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124227.log 2023-12-06T18:35:57.842 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136060.log 2023-12-06T18:35:57.842 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127870.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127870.log.gz 2023-12-06T18:35:57.842 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156577.log 2023-12-06T18:35:57.842 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124227.log.gz 2023-12-06T18:35:57.842 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136060.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136060.log.gz 2023-12-06T18:35:57.843 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156577.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156577.log.gz 2023-12-06T18:35:57.843 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141278.log 2023-12-06T18:35:57.843 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135705.log 2023-12-06T18:35:57.843 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141278.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141278.log.gz 2023-12-06T18:35:57.843 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117669.log 2023-12-06T18:35:57.843 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139504.log 2023-12-06T18:35:57.843 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.135705.log.gz 2023-12-06T18:35:57.843 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.117669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134022.log 2023-12-06T18:35:57.843 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117669.log.gz 2023-12-06T18:35:57.843 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139504.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139504.log.gz 2023-12-06T18:35:57.844 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134022.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134022.log.gz 2023-12-06T18:35:57.844 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-06T18:35:57.844 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154822.log 2023-12-06T18:35:57.844 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.154822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154822.log.gz 2023-12-06T18:35:57.844 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150436.log 2023-12-06T18:35:57.844 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141945.log 2023-12-06T18:35:57.844 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150436.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150436.log.gz 2023-12-06T18:35:57.844 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141945.log.gz 2023-12-06T18:35:57.844 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144916.log 2023-12-06T18:35:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142752.log 2023-12-06T18:35:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.144916.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144916.log.gz 2023-12-06T18:35:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142752.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142752.log.gz 2023-12-06T18:35:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151477.log 2023-12-06T18:35:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148162.log 2023-12-06T18:35:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151477.log.gz 2023-12-06T18:35:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148162.log.gz 2023-12-06T18:35:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162589.log 2023-12-06T18:35:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120001.log 2023-12-06T18:35:57.846 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162589.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162589.log.gz 2023-12-06T18:35:57.846 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120001.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120001.log.gz 2023-12-06T18:35:57.846 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145668.log 2023-12-06T18:35:57.846 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134767.log 2023-12-06T18:35:57.846 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145668.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145668.log.gz 2023-12-06T18:35:57.846 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134767.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134767.log.gz 2023-12-06T18:35:57.846 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138684.log 2023-12-06T18:35:57.846 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138684.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138684.log.gz 2023-12-06T18:35:57.846 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127790.log 2023-12-06T18:35:57.847 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119518.log 2023-12-06T18:35:57.847 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127790.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127790.log.gz 2023-12-06T18:35:57.847 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119518.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.119518.log.gz 2023-12-06T18:35:57.847 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147947.log 2023-12-06T18:35:57.847 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150328.log 2023-12-06T18:35:57.847 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147947.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147947.log.gz 2023-12-06T18:35:57.847 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150328.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150328.log.gz 2023-12-06T18:35:57.847 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161310.log 2023-12-06T18:35:57.847 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161547.log 2023-12-06T18:35:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161310.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161310.log.gz 2023-12-06T18:35:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161547.log.gz 2023-12-06T18:35:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143372.log 2023-12-06T18:35:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158908.log 2023-12-06T18:35:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.143372.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143372.log.gz 2023-12-06T18:35:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158908.log.gz 2023-12-06T18:35:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128141.log 2023-12-06T18:35:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141579.log 2023-12-06T18:35:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128141.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128141.log.gz 2023-12-06T18:35:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141579.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141579.log.gz 2023-12-06T18:35:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130575.log 2023-12-06T18:35:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130575.log.gz 2023-12-06T18:35:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119500.log 2023-12-06T18:35:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147000.log 2023-12-06T18:35:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119500.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119500.log.gz 2023-12-06T18:35:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147000.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147000.log.gz 2023-12-06T18:35:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137471.log 2023-12-06T18:35:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123259.log 2023-12-06T18:35:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137471.log.gz 2023-12-06T18:35:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123259.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123259.log.gz 2023-12-06T18:35:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121797.log 2023-12-06T18:35:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159230.log 2023-12-06T18:35:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121797.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121797.log.gz 2023-12-06T18:35:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159230.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159230.log.gz 2023-12-06T18:35:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162953.log 2023-12-06T18:35:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135291.log 2023-12-06T18:35:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162953.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162953.log.gz 2023-12-06T18:35:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135291.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135291.log.gz 2023-12-06T18:35:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121406.log 2023-12-06T18:35:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140192.log 2023-12-06T18:35:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121406.log.gz 2023-12-06T18:35:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140192.log.gz 2023-12-06T18:35:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157606.log 2023-12-06T18:35:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157606.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157606.log.gz 2023-12-06T18:35:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129450.log 2023-12-06T18:35:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131205.log 2023-12-06T18:35:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129450.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129450.log.gz 2023-12-06T18:35:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131205.log.gz 2023-12-06T18:35:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131987.log 2023-12-06T18:35:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136362.log 2023-12-06T18:35:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131987.log.gz 2023-12-06T18:35:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136362.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136362.log.gz 2023-12-06T18:35:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119134.log 2023-12-06T18:35:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134815.log 2023-12-06T18:35:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119134.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119134.log.gz 2023-12-06T18:35:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134815.log.gz 2023-12-06T18:35:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129229.log 2023-12-06T18:35:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157391.log 2023-12-06T18:35:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129229.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129229.log.gz 2023-12-06T18:35:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157391.log.gz 2023-12-06T18:35:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132856.log 2023-12-06T18:35:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137449.log 2023-12-06T18:35:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132856.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132856.log.gz 2023-12-06T18:35:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137449.log.gz 2023-12-06T18:35:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154468.log 2023-12-06T18:35:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153948.log 2023-12-06T18:35:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154468.log.gz 2023-12-06T18:35:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153948.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153948.log.gz 2023-12-06T18:35:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155337.log 2023-12-06T18:35:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155337.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155337.log.gz 2023-12-06T18:35:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151886.log 2023-12-06T18:35:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119112.log 2023-12-06T18:35:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151886.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151886.log.gz 2023-12-06T18:35:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119112.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119112.log.gz 2023-12-06T18:35:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154611.log 2023-12-06T18:35:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164918.log 2023-12-06T18:35:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154611.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154611.log.gz 2023-12-06T18:35:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.164918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164918.log.gz 2023-12-06T18:35:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133710.log 2023-12-06T18:35:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124397.log 2023-12-06T18:35:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133710.log.gz 2023-12-06T18:35:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124397.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124397.log.gz 2023-12-06T18:35:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139095.log 2023-12-06T18:35:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157756.log 2023-12-06T18:35:57.856 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139095.log.gz 2023-12-06T18:35:57.856 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157756.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157756.log.gz 2023-12-06T18:35:57.856 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162804.log 2023-12-06T18:35:57.856 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145346.log 2023-12-06T18:35:57.856 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162804.log.gz 2023-12-06T18:35:57.856 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145346.log.gz 2023-12-06T18:35:57.856 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152746.log 2023-12-06T18:35:57.856 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125468.log 2023-12-06T18:35:57.857 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152746.log.gz 2023-12-06T18:35:57.857 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125468.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125468.log.gz 2023-12-06T18:35:57.857 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153219.log 2023-12-06T18:35:57.857 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122785.log 2023-12-06T18:35:57.857 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153219.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153219.log.gz 2023-12-06T18:35:57.857 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122785.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122785.log.gz 2023-12-06T18:35:57.857 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119005.log 2023-12-06T18:35:57.857 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135165.log 2023-12-06T18:35:57.857 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119005.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119005.log.gz 2023-12-06T18:35:57.858 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135165.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135165.log.gz 2023-12-06T18:35:57.858 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132897.log 2023-12-06T18:35:57.858 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150479.log 2023-12-06T18:35:57.858 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132897.log: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.132897.log.gz 2023-12-06T18:35:57.858 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150479.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150479.log.gz 2023-12-06T18:35:57.858 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162567.log 2023-12-06T18:35:57.858 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132008.log 2023-12-06T18:35:57.858 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162567.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162567.log.gz 2023-12-06T18:35:57.858 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132008.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132008.log.gz 2023-12-06T18:35:57.859 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155278.log 2023-12-06T18:35:57.859 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138398.log 2023-12-06T18:35:57.859 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155278.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155278.log.gz 2023-12-06T18:35:57.859 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138398.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138398.log.gz 2023-12-06T18:35:57.859 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120338.log 2023-12-06T18:35:57.859 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146406.log 2023-12-06T18:35:57.859 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120338.log.gz 2023-12-06T18:35:57.859 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146406.log.gz 2023-12-06T18:35:57.859 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158738.log 2023-12-06T18:35:57.859 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139461.log 2023-12-06T18:35:57.860 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158738.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158738.log.gz 2023-12-06T18:35:57.860 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139461.log.gz 2023-12-06T18:35:57.860 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133130.log 2023-12-06T18:35:57.860 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139719.log 2023-12-06T18:35:57.860 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133130.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133130.log.gz 2023-12-06T18:35:57.860 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139719.log.gz 2023-12-06T18:35:57.860 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142793.log 2023-12-06T18:35:57.860 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123475.log 2023-12-06T18:35:57.860 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142793.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142793.log.gz 2023-12-06T18:35:57.861 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123475.log.gz 2023-12-06T18:35:57.861 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121069.log 2023-12-06T18:35:57.861 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157212.log 2023-12-06T18:35:57.861 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121069.log.gz 2023-12-06T18:35:57.861 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157212.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157212.log.gz 2023-12-06T18:35:57.861 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126910.log 2023-12-06T18:35:57.861 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149939.log 2023-12-06T18:35:57.861 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126910.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126910.log.gz 2023-12-06T18:35:57.861 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149939.log.gz 2023-12-06T18:35:57.862 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133774.log 2023-12-06T18:35:57.862 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129280.log 2023-12-06T18:35:57.862 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133774.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133774.log.gz 2023-12-06T18:35:57.862 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129280.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129280.log.gz 2023-12-06T18:35:57.862 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155656.log 2023-12-06T18:35:57.862 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123201.log 2023-12-06T18:35:57.862 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124346.log 2023-12-06T18:35:57.862 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155656.log.gz 2023-12-06T18:35:57.862 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123201.log.gz 2023-12-06T18:35:57.863 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124346.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124346.log.gz 2023-12-06T18:35:57.863 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119348.log 2023-12-06T18:35:57.863 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153872.log 2023-12-06T18:35:57.863 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119348.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119348.log.gz 2023-12-06T18:35:57.863 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153872.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153872.log.gz 2023-12-06T18:35:57.863 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121346.log 2023-12-06T18:35:57.863 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160715.log 2023-12-06T18:35:57.863 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121346.log.gz 2023-12-06T18:35:57.863 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160715.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160715.log.gz 2023-12-06T18:35:57.864 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130365.log 2023-12-06T18:35:57.864 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160241.log 2023-12-06T18:35:57.864 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130365.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130365.log.gz 2023-12-06T18:35:57.864 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160241.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160241.log.gz 2023-12-06T18:35:57.864 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139418.log 2023-12-06T18:35:57.864 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127050.log 2023-12-06T18:35:57.864 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139418.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139418.log.gz 2023-12-06T18:35:57.864 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127050.log.gz 2023-12-06T18:35:57.864 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127010.log 2023-12-06T18:35:57.864 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139547.log 2023-12-06T18:35:57.865 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127010.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127010.log.gz 2023-12-06T18:35:57.865 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139547.log.gz 2023-12-06T18:35:57.865 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151379.log 2023-12-06T18:35:57.865 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141600.log 2023-12-06T18:35:57.865 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151379.log.gz 2023-12-06T18:35:57.865 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141600.log.gz 2023-12-06T18:35:57.865 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119426.log 2023-12-06T18:35:57.865 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153240.log 2023-12-06T18:35:57.865 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119426.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119426.log.gz 2023-12-06T18:35:57.866 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153240.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153240.log.gz 2023-12-06T18:35:57.866 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123497.log 2023-12-06T18:35:57.866 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147818.log 2023-12-06T18:35:57.866 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123497.log.gz 2023-12-06T18:35:57.866 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147818.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147818.log.gz 2023-12-06T18:35:57.866 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133065.log 2023-12-06T18:35:57.866 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142483.log 2023-12-06T18:35:57.866 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133065.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133065.log.gz 2023-12-06T18:35:57.866 INFO:teuthology.orchestra.run.smithi123.stderr: 92.9% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-06T18:35:57.867 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142483.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142483.log.gz 2023-12-06T18:35:57.867 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158611.log 2023-12-06T18:35:57.867 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147710.log 2023-12-06T18:35:57.867 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156183.log 2023-12-06T18:35:57.867 INFO:teuthology.orchestra.run.smithi123.stderr: 57.5% -- replaced with /var/log/ceph/ceph-client.admin.158611.log.gz 2023-12-06T18:35:57.867 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120574.log 2023-12-06T18:35:57.867 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147710.log.gz 2023-12-06T18:35:57.867 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156183.log.gz 2023-12-06T18:35:57.867 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158221.log 2023-12-06T18:35:57.868 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120574.log.gz 2023-12-06T18:35:57.868 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158221.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158221.log.gz 2023-12-06T18:35:57.868 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159252.log 2023-12-06T18:35:57.868 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143093.log 2023-12-06T18:35:57.868 INFO:teuthology.orchestra.run.smithi123.stderr:gzip /var/log/ceph/ceph-client.admin.159252.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.139117.log 2023-12-06T18:35:57.868 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159252.log.gz 2023-12-06T18:35:57.868 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.143093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162073.log 2023-12-06T18:35:57.868 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143093.log.gz 2023-12-06T18:35:57.868 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137406.log 2023-12-06T18:35:57.869 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139117.log.gz 2023-12-06T18:35:57.869 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162073.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162073.log.gz 2023-12-06T18:35:57.869 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119576.log 2023-12-06T18:35:57.869 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137406.log.gz 2023-12-06T18:35:57.869 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134204.log 2023-12-06T18:35:57.869 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157233.log 2023-12-06T18:35:57.869 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119576.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119576.log.gz 2023-12-06T18:35:57.869 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134204.log: 24.4% -- replaced with /var/log/ceph/ceph-client.admin.134204.log.gz 2023-12-06T18:35:57.869 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121227.log 2023-12-06T18:35:57.869 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157233.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.157233.log.gz 2023-12-06T18:35:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.146322.log 2023-12-06T18:35:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137277.log 2023-12-06T18:35:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121227.log.gz 2023-12-06T18:35:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146322.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146322.log.gz 2023-12-06T18:35:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159166.log 2023-12-06T18:35:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137277.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137277.log.gz 2023-12-06T18:35:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142985.log 2023-12-06T18:35:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121366.log 2023-12-06T18:35:57.870 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159166.log.gz 2023-12-06T18:35:57.871 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142985.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142985.log.gz 2023-12-06T18:35:57.871 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156977.log 2023-12-06T18:35:57.871 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121366.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121366.log.gz 2023-12-06T18:35:57.871 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156977.log.gz 2023-12-06T18:35:57.871 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142816.log 2023-12-06T18:35:57.871 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125536.log 2023-12-06T18:35:57.871 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123411.log 2023-12-06T18:35:57.871 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142816.log.gz 2023-12-06T18:35:57.871 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158388.log 2023-12-06T18:35:57.872 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125536.log.gz 2023-12-06T18:35:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127350.log 2023-12-06T18:35:57.872 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123411.log.gz 2023-12-06T18:35:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121647.log 2023-12-06T18:35:57.872 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158388.log.gz 2023-12-06T18:35:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127350.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127350.log.gz 2023-12-06T18:35:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121647.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121647.log.gz 2023-12-06T18:35:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153906.log 2023-12-06T18:35:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127890.log 2023-12-06T18:35:57.873 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153906.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153906.log.gz 2023-12-06T18:35:57.873 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131289.log 2023-12-06T18:35:57.873 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127890.log.gz 2023-12-06T18:35:57.873 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131289.log.gz 2023-12-06T18:35:57.873 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151186.log 2023-12-06T18:35:57.873 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135923.log 2023-12-06T18:35:57.873 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151186.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151186.log.gz 2023-12-06T18:35:57.873 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135923.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135923.log.gz 2023-12-06T18:35:57.873 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161826.log 2023-12-06T18:35:57.873 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159531.log 2023-12-06T18:35:57.874 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161826.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161826.log.gz 2023-12-06T18:35:57.874 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159531.log.gz 2023-12-06T18:35:57.874 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143028.log 2023-12-06T18:35:57.874 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122549.log 2023-12-06T18:35:57.874 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.143028.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.143028.log.gz--verbose 2023-12-06T18:35:57.874 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.133108.log 2023-12-06T18:35:57.874 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122807.log 2023-12-06T18:35:57.874 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122549.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122549.log.gz 2023-12-06T18:35:57.874 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133108.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133108.log.gz 2023-12-06T18:35:57.875 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130155.log 2023-12-06T18:35:57.875 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122807.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122807.log.gzgzip 2023-12-06T18:35:57.875 INFO:teuthology.orchestra.run.smithi123.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.161504.log 2023-12-06T18:35:57.875 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144809.log 2023-12-06T18:35:57.875 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130155.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130155.log.gz 2023-12-06T18:35:57.875 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161504.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161504.log.gz 2023-12-06T18:35:57.875 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127030.log 2023-12-06T18:35:57.875 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132137.log 2023-12-06T18:35:57.875 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.144809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144809.log.gz 2023-12-06T18:35:57.876 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154630.log 2023-12-06T18:35:57.876 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127030.log.gz 2023-12-06T18:35:57.876 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132137.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132137.log.gz 2023-12-06T18:35:57.876 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154630.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154630.log.gz 2023-12-06T18:35:57.876 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121308.log 2023-12-06T18:35:57.876 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135439.log 2023-12-06T18:35:57.876 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121308.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121308.log.gz 2023-12-06T18:35:57.876 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135439.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135439.log.gz 2023-12-06T18:35:57.876 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159187.log 2023-12-06T18:35:57.877 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125604.log 2023-12-06T18:35:57.877 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159187.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.159187.log.gz/var/log/ceph/ceph-client.admin.138404.log 2023-12-06T18:35:57.877 INFO:teuthology.orchestra.run.smithi123.stderr: 2023-12-06T18:35:57.877 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118660.log 2023-12-06T18:35:57.877 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125604.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125604.log.gz 2023-12-06T18:35:57.877 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138404.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138404.log.gz 2023-12-06T18:35:57.877 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133538.log 2023-12-06T18:35:57.877 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.118660.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118660.log.gz 2023-12-06T18:35:57.877 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133538.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133538.log.gz 2023-12-06T18:35:57.878 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120445.log 2023-12-06T18:35:57.878 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140696.log 2023-12-06T18:35:57.878 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134384.log 2023-12-06T18:35:57.878 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120445.log.gz 2023-12-06T18:35:57.878 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121432.log 2023-12-06T18:35:57.878 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140696.log.gz 2023-12-06T18:35:57.878 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150264.log 2023-12-06T18:35:57.878 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134384.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134384.log.gz 2023-12-06T18:35:57.878 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132395.log 2023-12-06T18:35:57.879 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121432.log.gz 2023-12-06T18:35:57.879 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132374.log 2023-12-06T18:35:57.879 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150264.log.gz 2023-12-06T18:35:57.879 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123604.log 2023-12-06T18:35:57.879 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132395.log.gz 2023-12-06T18:35:57.879 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139353.log 2023-12-06T18:35:57.879 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132374.log.gz 2023-12-06T18:35:57.879 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157350.log 2023-12-06T18:35:57.879 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123604.log.gz 2023-12-06T18:35:57.880 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117171.log 2023-12-06T18:35:57.880 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139353.log.gz 2023-12-06T18:35:57.880 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160176.log 2023-12-06T18:35:57.880 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157350.log.gz 2023-12-06T18:35:57.880 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.117171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140717.log 2023-12-06T18:35:57.880 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117171.log.gz 2023-12-06T18:35:57.880 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144748.log 2023-12-06T18:35:57.880 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160176.log.gz 2023-12-06T18:35:57.880 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139203.log 2023-12-06T18:35:57.880 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140717.log.gz 2023-12-06T18:35:57.881 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142354.log 2023-12-06T18:35:57.881 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.144748.log: 56.6% -- replaced with /var/log/ceph/ceph-client.admin.144748.log.gz 2023-12-06T18:35:57.881 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132682.log 2023-12-06T18:35:57.881 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139203.log.gz 2023-12-06T18:35:57.881 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122140.log 2023-12-06T18:35:57.881 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142354.log.gz 2023-12-06T18:35:57.881 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125349.log 2023-12-06T18:35:57.881 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132682.log.gz 2023-12-06T18:35:57.881 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125026.log 2023-12-06T18:35:57.882 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122140.log.gz 2023-12-06T18:35:57.882 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125349.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125349.log.gz 2023-12-06T18:35:57.882 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125026.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.125026.log.gz 2023-12-06T18:35:57.882 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128209.log 2023-12-06T18:35:57.882 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159918.log 2023-12-06T18:35:57.882 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128209.log.gz 2023-12-06T18:35:57.882 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159918.log.gz 2023-12-06T18:35:57.882 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129714.log 2023-12-06T18:35:57.882 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151265.log 2023-12-06T18:35:57.883 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129714.log.gz 2023-12-06T18:35:57.883 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151265.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151265.log.gz 2023-12-06T18:35:57.883 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159789.log 2023-12-06T18:35:57.883 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142074.log 2023-12-06T18:35:57.883 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159789.log.gz 2023-12-06T18:35:57.883 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142074.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142074.log.gz 2023-12-06T18:35:57.883 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129966.log 2023-12-06T18:35:57.883 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149306.log 2023-12-06T18:35:57.883 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129966.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129966.log.gz 2023-12-06T18:35:57.883 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149306.log.gz 2023-12-06T18:35:57.884 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129348.log 2023-12-06T18:35:57.884 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156303.log 2023-12-06T18:35:57.884 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129348.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129348.log.gz 2023-12-06T18:35:57.884 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156303.log.gz 2023-12-06T18:35:57.884 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159445.log 2023-12-06T18:35:57.884 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161525.log 2023-12-06T18:35:57.884 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159445.log.gz 2023-12-06T18:35:57.884 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161525.log.gz 2023-12-06T18:35:57.884 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153503.log 2023-12-06T18:35:57.885 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122656.log 2023-12-06T18:35:57.885 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153503.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153503.log.gz 2023-12-06T18:35:57.885 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122656.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122656.log.gz 2023-12-06T18:35:57.885 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155533.log 2023-12-06T18:35:57.885 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126770.log 2023-12-06T18:35:57.885 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155533.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155533.log.gz 2023-12-06T18:35:57.885 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126770.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126770.log.gz 2023-12-06T18:35:57.885 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156478.log 2023-12-06T18:35:57.885 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154551.log 2023-12-06T18:35:57.886 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156478.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156478.log.gz 2023-12-06T18:35:57.886 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154551.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154551.log.gz 2023-12-06T18:35:57.886 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153604.log 2023-12-06T18:35:57.886 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162031.log 2023-12-06T18:35:57.886 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153604.log.gz 2023-12-06T18:35:57.886 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162031.log: 52.4% -- replaced with /var/log/ceph/ceph-client.admin.162031.log.gz 2023-12-06T18:35:57.886 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145389.log 2023-12-06T18:35:57.886 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150414.log 2023-12-06T18:35:57.887 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145389.log.gz 2023-12-06T18:35:57.887 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150414.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150414.log.gz 2023-12-06T18:35:57.887 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121090.log 2023-12-06T18:35:57.887 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142031.log 2023-12-06T18:35:57.887 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121090.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121090.log.gz 2023-12-06T18:35:57.887 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142031.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142031.log.gz 2023-12-06T18:35:57.887 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133474.log 2023-12-06T18:35:57.887 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153412.log 2023-12-06T18:35:57.887 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133474.log.gz 2023-12-06T18:35:57.888 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153412.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153412.log.gz 2023-12-06T18:35:57.888 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123374.log 2023-12-06T18:35:57.888 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134446.log 2023-12-06T18:35:57.888 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123374.log.gz 2023-12-06T18:35:57.888 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134446.log: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.134446.log.gz 2023-12-06T18:35:57.888 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133280.log 2023-12-06T18:35:57.888 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145239.log 2023-12-06T18:35:57.888 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133280.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133280.log.gz 2023-12-06T18:35:57.888 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145239.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145239.log.gz 2023-12-06T18:35:57.889 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145791.log 2023-12-06T18:35:57.889 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165594.log 2023-12-06T18:35:57.889 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158181.log 2023-12-06T18:35:57.889 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145791.log.gz 2023-12-06T18:35:57.889 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.165594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128719.log 2023-12-06T18:35:57.889 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165594.log.gz 2023-12-06T18:35:57.889 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153326.log 2023-12-06T18:35:57.889 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158181.log.gz 2023-12-06T18:35:57.889 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134225.log 2023-12-06T18:35:57.890 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128719.log.gz 2023-12-06T18:35:57.890 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158449.log 2023-12-06T18:35:57.890 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153326.log.gz 2023-12-06T18:35:57.890 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138579.log 2023-12-06T18:35:57.890 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134225.log.gz 2023-12-06T18:35:57.890 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162094.log 2023-12-06T18:35:57.890 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158449.log.gz 2023-12-06T18:35:57.890 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126890.log 2023-12-06T18:35:57.890 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138579.log.gz 2023-12-06T18:35:57.891 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153969.log 2023-12-06T18:35:57.891 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162094.log.gz 2023-12-06T18:35:57.891 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128413.log 2023-12-06T18:35:57.891 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126890.log.gz 2023-12-06T18:35:57.891 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145910.log 2023-12-06T18:35:57.891 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153969.log.gz 2023-12-06T18:35:57.891 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146386.log 2023-12-06T18:35:57.891 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128413.log.gz 2023-12-06T18:35:57.891 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124907.log 2023-12-06T18:35:57.892 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145910.log.gz 2023-12-06T18:35:57.892 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146386.log.gz 2023-12-06T18:35:57.892 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124907.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.124907.log.gz 2023-12-06T18:35:57.892 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131922.log 2023-12-06T18:35:57.892 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120510.log 2023-12-06T18:35:57.892 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131922.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131922.log.gz 2023-12-06T18:35:57.892 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120510.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120510.log.gz 2023-12-06T18:35:57.892 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162610.log 2023-12-06T18:35:57.892 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159359.log 2023-12-06T18:35:57.893 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162610.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162610.log.gz 2023-12-06T18:35:57.893 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159359.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159359.log.gz 2023-12-06T18:35:57.893 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155026.log 2023-12-06T18:35:57.893 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119659.log 2023-12-06T18:35:57.893 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155026.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155026.log.gz 2023-12-06T18:35:57.893 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148033.log 2023-12-06T18:35:57.893 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148705.log 2023-12-06T18:35:57.893 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119659.log.gz 2023-12-06T18:35:57.893 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117277.log 2023-12-06T18:35:57.894 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148033.log.gz 2023-12-06T18:35:57.894 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128991.log 2023-12-06T18:35:57.894 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148705.log.gz 2023-12-06T18:35:57.894 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.117277.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117277.log.gz 2023-12-06T18:35:57.894 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128991.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128991.log.gz 2023-12-06T18:35:57.894 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146764.log 2023-12-06T18:35:57.894 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155835.log 2023-12-06T18:35:57.894 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146764.log.gz 2023-12-06T18:35:57.894 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155835.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155835.log.gz 2023-12-06T18:35:57.895 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123690.log 2023-12-06T18:35:57.895 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119773.log 2023-12-06T18:35:57.895 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148453.log 2023-12-06T18:35:57.895 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123690.log.gz 2023-12-06T18:35:57.895 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114312.log 2023-12-06T18:35:57.895 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.119773.log.gz 2023-12-06T18:35:57.895 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154301.log 2023-12-06T18:35:57.895 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148453.log.gz 2023-12-06T18:35:57.895 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.114312.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114312.log.gz 2023-12-06T18:35:57.895 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121625.log 2023-12-06T18:35:57.896 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137041.log 2023-12-06T18:35:57.896 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154301.log.gz 2023-12-06T18:35:57.896 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141493.log 2023-12-06T18:35:57.896 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121625.log.gz 2023-12-06T18:35:57.896 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165447.log 2023-12-06T18:35:57.896 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137041.log.gz 2023-12-06T18:35:57.896 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132266.log 2023-12-06T18:35:57.896 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141493.log.gz 2023-12-06T18:35:57.896 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.165447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139525.log 2023-12-06T18:35:57.897 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165447.log.gz 2023-12-06T18:35:57.897 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132266.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132266.log.gz 2023-12-06T18:35:57.897 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139525.log.gz 2023-12-06T18:35:57.897 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153090.log 2023-12-06T18:35:57.897 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128821.log 2023-12-06T18:35:57.897 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153090.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153090.log.gz 2023-12-06T18:35:57.897 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128821.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128821.log.gz 2023-12-06T18:35:57.897 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149112.log 2023-12-06T18:35:57.898 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125672.log 2023-12-06T18:35:57.898 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149112.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.149112.log.gz/var/log/ceph/ceph-client.admin.150500.log 2023-12-06T18:35:57.898 INFO:teuthology.orchestra.run.smithi123.stderr: 2023-12-06T18:35:57.898 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151846.log 2023-12-06T18:35:57.898 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125672.log.gz 2023-12-06T18:35:57.898 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150500.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150500.log.gz 2023-12-06T18:35:57.898 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151846.log: 10.7% -- replaced with /var/log/ceph/ceph-client.admin.151846.log.gz 2023-12-06T18:35:57.898 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133667.log 2023-12-06T18:35:57.898 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130680.log 2023-12-06T18:35:57.899 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133667.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.133667.log.gz--verbose 2023-12-06T18:35:57.899 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.141171.log 2023-12-06T18:35:57.899 INFO:teuthology.orchestra.run.smithi123.stderr:gzip /var/log/ceph/ceph-client.admin.130680.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.154530.log 2023-12-06T18:35:57.899 INFO:teuthology.orchestra.run.smithi123.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.130680.log.gz 2023-12-06T18:35:57.899 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134939.log 2023-12-06T18:35:57.899 INFO:teuthology.orchestra.run.smithi123.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.141171.log.gz 2023-12-06T18:35:57.899 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159854.log 2023-12-06T18:35:57.899 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154530.log.gz 2023-12-06T18:35:57.899 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153111.log 2023-12-06T18:35:57.900 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134939.log.gz 2023-12-06T18:35:57.900 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133388.log 2023-12-06T18:35:57.900 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159854.log.gz 2023-12-06T18:35:57.900 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126930.log 2023-12-06T18:35:57.900 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153111.log.gz 2023-12-06T18:35:57.900 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150796.log 2023-12-06T18:35:57.900 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133388.log.gz 2023-12-06T18:35:57.900 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127950.log 2023-12-06T18:35:57.900 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126930.log.gz 2023-12-06T18:35:57.901 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120381.log 2023-12-06T18:35:57.901 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150796.log.gz 2023-12-06T18:35:57.901 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143157.log 2023-12-06T18:35:57.901 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127950.log.gz 2023-12-06T18:35:57.901 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120381.log.gz 2023-12-06T18:35:57.901 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.143157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143157.log.gz 2023-12-06T18:35:57.901 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138377.log 2023-12-06T18:35:57.901 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152294.log 2023-12-06T18:35:57.901 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138377.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138377.log.gz 2023-12-06T18:35:57.902 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158886.log 2023-12-06T18:35:57.902 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128906.log 2023-12-06T18:35:57.902 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152294.log.gz 2023-12-06T18:35:57.902 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126690.log 2023-12-06T18:35:57.902 INFO:teuthology.orchestra.run.smithi123.stderr: 53.7% -- replaced with /var/log/ceph/ceph-client.admin.158886.log.gz 2023-12-06T18:35:57.902 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122076.log 2023-12-06T18:35:57.902 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128906.log.gz 2023-12-06T18:35:57.902 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126690.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126690.log.gz 2023-12-06T18:35:57.903 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122076.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122076.log.gz 2023-12-06T18:35:57.903 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138894.log 2023-12-06T18:35:57.903 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149091.log 2023-12-06T18:35:57.903 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138894.log.gz 2023-12-06T18:35:57.903 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160757.log 2023-12-06T18:35:57.903 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161847.log 2023-12-06T18:35:57.903 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149091.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149091.log.gz 2023-12-06T18:35:57.903 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160757.log.gz 2023-12-06T18:35:57.903 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120961.log 2023-12-06T18:35:57.904 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126390.log 2023-12-06T18:35:57.904 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161847.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161847.log.gz 2023-12-06T18:35:57.904 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120961.log.gz 2023-12-06T18:35:57.904 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126390.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126390.log.gz 2023-12-06T18:35:57.904 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149005.log 2023-12-06T18:35:57.904 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129819.log 2023-12-06T18:35:57.904 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149005.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149005.log.gz 2023-12-06T18:35:57.904 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162331.log 2023-12-06T18:35:57.904 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129819.log: /var/log/ceph/ceph-client.admin.145518.log 2023-12-06T18:35:57.905 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129819.log.gz 2023-12-06T18:35:57.905 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162331.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162331.log.gz 2023-12-06T18:35:57.905 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153469.log 2023-12-06T18:35:57.905 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124975.log 2023-12-06T18:35:57.905 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145518.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145518.log.gz 2023-12-06T18:35:57.905 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150831.log 2023-12-06T18:35:57.905 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153469.log.gz 2023-12-06T18:35:57.905 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156460.log 2023-12-06T18:35:57.905 INFO:teuthology.orchestra.run.smithi123.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124975.log.gz 2023-12-06T18:35:57.905 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150831.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150831.log.gz 2023-12-06T18:35:57.906 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156460.log.gz 2023-12-06T18:35:57.906 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148768.log 2023-12-06T18:35:57.906 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142418.log 2023-12-06T18:35:57.906 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148768.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148768.log.gz 2023-12-06T18:35:57.906 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134835.log 2023-12-06T18:35:57.906 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122162.log 2023-12-06T18:35:57.906 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142418.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142418.log.gz 2023-12-06T18:35:57.906 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134835.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134835.log.gz 2023-12-06T18:35:57.906 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122162.log.gz 2023-12-06T18:35:57.907 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134125.log 2023-12-06T18:35:57.907 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132202.log 2023-12-06T18:35:57.907 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131965.log 2023-12-06T18:35:57.907 INFO:teuthology.orchestra.run.smithi123.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.134125.log.gz 2023-12-06T18:35:57.907 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 /var/log/ceph/ceph-client.admin.132202.log: --verbose -- /var/log/ceph/ceph-client.admin.152961.log 2023-12-06T18:35:57.907 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132202.log.gz 2023-12-06T18:35:57.907 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131965.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131965.log.gz 2023-12-06T18:35:57.907 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152961.log.gz 2023-12-06T18:35:57.908 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125927.log 2023-12-06T18:35:57.908 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144895.log 2023-12-06T18:35:57.908 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154010.log 2023-12-06T18:35:57.908 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125927.log.gz 2023-12-06T18:35:57.908 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.144895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138526.log 2023-12-06T18:35:57.908 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144895.log.gz 2023-12-06T18:35:57.908 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154010.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154010.log.gz 2023-12-06T18:35:57.908 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138526.log.gz 2023-12-06T18:35:57.908 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155451.log 2023-12-06T18:35:57.909 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149980.log 2023-12-06T18:35:57.909 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155451.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155451.log.gz 2023-12-06T18:35:57.909 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140392.log 2023-12-06T18:35:57.909 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154648.log 2023-12-06T18:35:57.909 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149980.log.gz 2023-12-06T18:35:57.909 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140392.log: 22.9% -- replaced with /var/log/ceph/ceph-client.admin.140392.log.gz 2023-12-06T18:35:57.909 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154648.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154648.log.gz 2023-12-06T18:35:57.909 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146637.log 2023-12-06T18:35:57.909 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165839.log 2023-12-06T18:35:57.910 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146637.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.146637.log.gz--verbose 2023-12-06T18:35:57.910 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.150135.log 2023-12-06T18:35:57.910 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165839.log: /var/log/ceph/ceph-client.admin.132180.log 2023-12-06T18:35:57.910 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165839.log.gz 2023-12-06T18:35:57.910 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153176.log 2023-12-06T18:35:57.910 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150135.log.gz 2023-12-06T18:35:57.910 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118259.log 2023-12-06T18:35:57.910 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132180.log.gz 2023-12-06T18:35:57.911 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153176.log.gz 2023-12-06T18:35:57.911 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.118259.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118259.log.gz 2023-12-06T18:35:57.911 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134104.log 2023-12-06T18:35:57.911 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153794.log 2023-12-06T18:35:57.911 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125009.log 2023-12-06T18:35:57.911 INFO:teuthology.orchestra.run.smithi123.stderr: 53.3% -- replaced with /var/log/ceph/ceph-client.admin.134104.log.gz 2023-12-06T18:35:57.911 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153794.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153794.log.gz 2023-12-06T18:35:57.911 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125009.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.125009.log.gz 2023-12-06T18:35:57.911 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127550.log 2023-12-06T18:35:57.911 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119925.log 2023-12-06T18:35:57.912 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127550.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127550.log.gz 2023-12-06T18:35:57.912 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134703.log 2023-12-06T18:35:57.912 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119925.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.119925.log.gz 2023-12-06T18:35:57.912 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134703.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134703.log.gz 2023-12-06T18:35:57.912 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138313.log 2023-12-06T18:35:57.912 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133603.log 2023-12-06T18:35:57.912 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138313.log.gz 2023-12-06T18:35:57.912 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135312.log 2023-12-06T18:35:57.913 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136263.log 2023-12-06T18:35:57.913 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133603.log.gz 2023-12-06T18:35:57.913 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135312.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.135312.log.gz/var/log/ceph/ceph-client.admin.132331.log 2023-12-06T18:35:57.913 INFO:teuthology.orchestra.run.smithi123.stderr: 2023-12-06T18:35:57.913 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130029.log 2023-12-06T18:35:57.913 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136263.log.gz 2023-12-06T18:35:57.913 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132331.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132331.log.gz 2023-12-06T18:35:57.913 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130029.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130029.log.gz 2023-12-06T18:35:57.913 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130617.log 2023-12-06T18:35:57.913 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165292.log 2023-12-06T18:35:57.914 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130617.log.gz 2023-12-06T18:35:57.914 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.165292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165292.log.gz 2023-12-06T18:35:57.914 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120039.log 2023-12-06T18:35:57.914 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161740.log 2023-12-06T18:35:57.914 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120039.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120039.log.gz 2023-12-06T18:35:57.914 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161740.log.gz 2023-12-06T18:35:57.914 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136604.log 2023-12-06T18:35:57.914 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156364.log 2023-12-06T18:35:57.914 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.136604.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.136604.log.gz--verbose 2023-12-06T18:35:57.915 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.135022.log 2023-12-06T18:35:57.915 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140132.log 2023-12-06T18:35:57.915 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156364.log.gz 2023-12-06T18:35:57.915 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135022.log: 57.0% -- replaced with /var/log/ceph/ceph-client.admin.135022.log.gz 2023-12-06T18:35:57.915 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149241.log 2023-12-06T18:35:57.915 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140132.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140132.log.gz 2023-12-06T18:35:57.915 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158822.log 2023-12-06T18:35:57.915 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121561.log 2023-12-06T18:35:57.915 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149241.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149241.log.gz 2023-12-06T18:35:57.916 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133259.log 2023-12-06T18:35:57.916 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158822.log.gz 2023-12-06T18:35:57.916 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121561.log.gz 2023-12-06T18:35:57.916 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131583.log 2023-12-06T18:35:57.916 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117914.log 2023-12-06T18:35:57.916 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133259.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133259.log.gz 2023-12-06T18:35:57.916 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131583.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.131583.log.gz--verbose 2023-12-06T18:35:57.916 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.134287.log 2023-12-06T18:35:57.916 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.117914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147193.log 2023-12-06T18:35:57.917 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117914.log.gz 2023-12-06T18:35:57.917 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134287.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134287.log.gz 2023-12-06T18:35:57.917 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147193.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147193.log.gz 2023-12-06T18:35:57.917 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157176.log 2023-12-06T18:35:57.917 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125077.log 2023-12-06T18:35:57.917 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157176.log.gz 2023-12-06T18:35:57.917 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125077.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.125077.log.gz 2023-12-06T18:35:57.917 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128566.log 2023-12-06T18:35:57.917 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155817.log 2023-12-06T18:35:57.917 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128566.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128566.log.gz 2023-12-06T18:35:57.918 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155817.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155817.log.gz 2023-12-06T18:35:57.918 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150371.log 2023-12-06T18:35:57.918 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132703.log 2023-12-06T18:35:57.918 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150371.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.150371.log.gz--verbose 2023-12-06T18:35:57.918 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.144381.log 2023-12-06T18:35:57.918 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152058.log 2023-12-06T18:35:57.918 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132703.log.gz 2023-12-06T18:35:57.918 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.144381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144381.log.gz 2023-12-06T18:35:57.918 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152058.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152058.log.gz 2023-12-06T18:35:57.919 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129008.log 2023-12-06T18:35:57.919 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135602.log 2023-12-06T18:35:57.919 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129008.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129008.log.gz 2023-12-06T18:35:57.919 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146700.log 2023-12-06T18:35:57.919 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129777.log 2023-12-06T18:35:57.919 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135602.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135602.log.gz 2023-12-06T18:35:57.919 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146871.log 2023-12-06T18:35:57.919 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146700.log.gz 2023-12-06T18:35:57.919 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131331.log 2023-12-06T18:35:57.920 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129777.log.gz 2023-12-06T18:35:57.920 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146871.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146871.log.gz 2023-12-06T18:35:57.920 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131331.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131331.log.gz 2023-12-06T18:35:57.920 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149134.log 2023-12-06T18:35:57.920 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155871.log 2023-12-06T18:35:57.920 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149134.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149134.log.gz 2023-12-06T18:35:57.920 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155871.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155871.log.gz 2023-12-06T18:35:57.920 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140571.log 2023-12-06T18:35:57.920 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147258.log 2023-12-06T18:35:57.921 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140571.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.140571.log.gz--verbose 2023-12-06T18:35:57.921 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-client.admin.119811.log 2023-12-06T18:35:57.921 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141342.log 2023-12-06T18:35:57.921 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147258.log.gz 2023-12-06T18:35:57.921 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119811.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.119811.log.gz 2023-12-06T18:35:57.921 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141342.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141342.log.gz 2023-12-06T18:35:57.921 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139950.log 2023-12-06T18:35:57.921 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158122.log 2023-12-06T18:35:57.921 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139950.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.139950.log.gz--verbose 2023-12-06T18:35:57.921 INFO:teuthology.orchestra.run.smithi123.stderr:-- /var/log/ceph/ceph-osd.1.log 2023-12-06T18:35:57.922 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128481.log 2023-12-06T18:35:57.922 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158122.log.gz 2023-12-06T18:35:57.922 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.128481.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128481.log.gz 2023-12-06T18:35:57.922 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146549.log 2023-12-06T18:35:57.922 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143071.log 2023-12-06T18:35:57.922 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146549.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146549.log.gz 2023-12-06T18:35:57.922 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.143071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143071.log.gz 2023-12-06T18:35:57.922 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143458.log 2023-12-06T18:35:57.923 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159295.log 2023-12-06T18:35:57.923 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.143458.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143458.log.gz 2023-12-06T18:35:57.923 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159295.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159295.log.gz 2023-12-06T18:35:57.923 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141988.log 2023-12-06T18:35:57.923 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159596.log 2023-12-06T18:35:57.923 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141988.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141988.log.gz 2023-12-06T18:35:57.923 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159596.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159596.log.gz 2023-12-06T18:35:57.923 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129690.log 2023-12-06T18:35:57.923 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126510.log 2023-12-06T18:35:57.923 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129690.log: 54.8% -- replaced with /var/log/ceph/ceph-client.admin.129690.log.gz 2023-12-06T18:35:57.924 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126510.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126510.log.gz 2023-12-06T18:35:57.924 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148876.log 2023-12-06T18:35:57.924 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158261.log 2023-12-06T18:35:57.924 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148876.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148876.log.gz 2023-12-06T18:35:57.924 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158261.log: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.158261.log.gz 2023-12-06T18:35:57.924 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123712.log 2023-12-06T18:35:57.924 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152789.log 2023-12-06T18:35:57.924 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123712.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123712.log.gz 2023-12-06T18:35:57.924 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152789.log.gz 2023-12-06T18:35:57.925 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143308.log 2023-12-06T18:35:57.925 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135503.log 2023-12-06T18:35:57.925 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.143308.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143308.log.gz 2023-12-06T18:35:57.925 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135503.log: 23.2% -- replaced with /var/log/ceph/ceph-client.admin.135503.log.gz 2023-12-06T18:35:57.925 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120095.log 2023-12-06T18:35:57.925 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121776.log 2023-12-06T18:35:57.925 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120095.log.gz 2023-12-06T18:35:57.925 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121776.log.gz 2023-12-06T18:35:57.925 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145303.log 2023-12-06T18:35:57.926 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129076.log 2023-12-06T18:35:57.926 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145303.log.gz 2023-12-06T18:35:57.926 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129076.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129076.log.gz 2023-12-06T18:35:57.926 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149263.log 2023-12-06T18:35:57.926 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158758.log 2023-12-06T18:35:57.926 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149263.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149263.log.gz 2023-12-06T18:35:57.926 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158758.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158758.log.gz 2023-12-06T18:35:57.926 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126610.log 2023-12-06T18:35:57.926 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143200.log 2023-12-06T18:35:57.927 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126610.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126610.log.gz 2023-12-06T18:35:57.927 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.143200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143200.log.gz 2023-12-06T18:35:57.927 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118681.log 2023-12-06T18:35:57.927 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138543.log 2023-12-06T18:35:57.927 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.118681.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118681.log.gz 2023-12-06T18:35:57.927 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138543.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138543.log.gz 2023-12-06T18:35:57.927 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129569.log 2023-12-06T18:35:57.927 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148662.log 2023-12-06T18:35:57.927 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129569.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129569.log.gz 2023-12-06T18:35:57.928 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148662.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148662.log.gz 2023-12-06T18:35:57.928 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137234.log 2023-12-06T18:35:57.928 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143179.log 2023-12-06T18:35:57.928 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137234.log: 27.6% -- replaced with /var/log/ceph/ceph-client.admin.137234.log.gz 2023-12-06T18:35:57.928 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.143179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143179.log.gz 2023-12-06T18:35:57.928 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151806.log 2023-12-06T18:35:57.928 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162438.log 2023-12-06T18:35:57.928 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.151806.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151806.log.gz 2023-12-06T18:35:57.928 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162438.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162438.log.gz 2023-12-06T18:35:57.929 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122484.log 2023-12-06T18:35:57.929 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150779.log 2023-12-06T18:35:57.929 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122484.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122484.log.gz 2023-12-06T18:35:57.929 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150779.log.gz 2023-12-06T18:35:57.929 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118063.log 2023-12-06T18:35:57.929 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.118063.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118063.log.gz 2023-12-06T18:35:57.929 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121145.log 2023-12-06T18:35:57.929 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131226.log 2023-12-06T18:35:57.929 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.121145.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121145.log.gz 2023-12-06T18:35:57.929 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131226.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131226.log.gz 2023-12-06T18:35:57.930 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128685.log 2023-12-06T18:35:57.930 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153004.log 2023-12-06T18:35:57.930 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128685.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128685.log.gz 2023-12-06T18:35:57.930 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153004.log.gz 2023-12-06T18:35:57.930 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127170.log 2023-12-06T18:35:57.930 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161224.log 2023-12-06T18:35:57.930 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127170.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127170.log.gz 2023-12-06T18:35:57.930 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.161224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161224.log.gz 2023-12-06T18:35:57.931 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127370.log 2023-12-06T18:35:57.931 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126010.log 2023-12-06T18:35:57.931 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127370.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127370.log.gz 2023-12-06T18:35:57.931 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.126010.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126010.log.gz 2023-12-06T18:35:57.931 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162481.log 2023-12-06T18:35:57.931 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156283.log 2023-12-06T18:35:57.931 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162481.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162481.log.gz 2023-12-06T18:35:57.931 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156283.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156283.log.gz 2023-12-06T18:35:57.931 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158673.log 2023-12-06T18:35:57.931 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137514.log 2023-12-06T18:35:57.932 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158673.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158673.log.gz 2023-12-06T18:35:57.932 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137514.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137514.log.gz 2023-12-06T18:35:57.932 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125315.log 2023-12-06T18:35:57.932 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139807.log 2023-12-06T18:35:57.932 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125315.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125315.log.gz 2023-12-06T18:35:57.932 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139807.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139807.log.gz 2023-12-06T18:35:57.932 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122269.log 2023-12-06T18:35:57.932 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123927.log 2023-12-06T18:35:57.932 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122269.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122269.log.gz 2023-12-06T18:35:57.933 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123927.log.gz 2023-12-06T18:35:57.933 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153305.log 2023-12-06T18:35:57.933 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148811.log 2023-12-06T18:35:57.933 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153305.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153305.log.gz 2023-12-06T18:35:57.933 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148811.log.gz 2023-12-06T18:35:57.933 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155573.log 2023-12-06T18:35:57.933 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134167.log 2023-12-06T18:35:57.933 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155573.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155573.log.gz 2023-12-06T18:35:57.933 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134167.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134167.log.gz 2023-12-06T18:35:57.934 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157735.log 2023-12-06T18:35:57.934 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159273.log 2023-12-06T18:35:57.934 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157735.log.gz 2023-12-06T18:35:57.934 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159273.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159273.log.gz 2023-12-06T18:35:57.934 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128498.log 2023-12-06T18:35:57.934 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138334.log 2023-12-06T18:35:57.934 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128498.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128498.log.gz 2023-12-06T18:35:57.934 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.138334.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138334.log.gz 2023-12-06T18:35:57.934 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141236.log 2023-12-06T18:35:57.935 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152316.log 2023-12-06T18:35:57.935 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.141236.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141236.log.gz 2023-12-06T18:35:57.935 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152316.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152316.log.gz 2023-12-06T18:35:57.935 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133302.log 2023-12-06T18:35:57.935 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154862.log 2023-12-06T18:35:57.935 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133302.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133302.log.gz 2023-12-06T18:35:57.935 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.154862.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154862.log.gz 2023-12-06T18:35:57.935 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125910.log 2023-12-06T18:35:57.935 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137689.log 2023-12-06T18:35:57.936 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125910.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125910.log.gz 2023-12-06T18:35:57.936 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137689.log.gz 2023-12-06T18:35:57.936 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134342.log 2023-12-06T18:35:57.936 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148919.log 2023-12-06T18:35:57.936 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.134342.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134342.log.gz 2023-12-06T18:35:57.936 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.148919.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148919.log.gz 2023-12-06T18:35:57.936 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119327.log 2023-12-06T18:35:57.936 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123219.log 2023-12-06T18:35:57.936 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119327.log.gz 2023-12-06T18:35:57.937 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123219.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123219.log.gz 2023-12-06T18:35:57.937 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160530.log 2023-12-06T18:35:57.937 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125740.log 2023-12-06T18:35:57.937 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160530.log.gz 2023-12-06T18:35:57.937 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125740.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125740.log.gz 2023-12-06T18:35:57.937 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149478.log 2023-12-06T18:35:57.937 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132438.log 2023-12-06T18:35:57.937 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.149478.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149478.log.gz 2023-12-06T18:35:57.937 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132438.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132438.log.gz 2023-12-06T18:35:57.937 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155696.log 2023-12-06T18:35:57.938 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120768.log 2023-12-06T18:35:57.938 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155696.log: 56.4% -- replaced with /var/log/ceph/ceph-client.admin.155696.log.gz 2023-12-06T18:35:57.938 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120768.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120768.log.gz 2023-12-06T18:35:57.938 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165030.log 2023-12-06T18:35:57.938 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133151.log 2023-12-06T18:35:57.938 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.165030.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165030.log.gz 2023-12-06T18:35:57.938 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133151.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133151.log.gz 2023-12-06T18:35:57.938 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122978.log 2023-12-06T18:35:57.939 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123948.log 2023-12-06T18:35:57.939 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122978.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122978.log.gz 2023-12-06T18:35:57.939 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.123948.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123948.log.gz 2023-12-06T18:35:57.939 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130827.log 2023-12-06T18:35:57.939 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127470.log 2023-12-06T18:35:57.939 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130827.log.gz 2023-12-06T18:35:57.939 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127470.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127470.log.gz 2023-12-06T18:35:57.939 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133452.log 2023-12-06T18:35:57.939 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150694.log 2023-12-06T18:35:57.940 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.133452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133452.log.gz 2023-12-06T18:35:57.940 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.150694.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150694.log.gz 2023-12-06T18:35:57.940 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129178.log 2023-12-06T18:35:57.940 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160673.log 2023-12-06T18:35:57.940 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129178.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129178.log.gz 2023-12-06T18:35:57.940 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160673.log: 24.4% -- replaced with /var/log/ceph/ceph-client.admin.160673.log.gz 2023-12-06T18:35:57.940 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131604.log 2023-12-06T18:35:57.940 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137646.log 2023-12-06T18:35:57.940 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131604.log.gz 2023-12-06T18:35:57.940 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137646.log.gz 2023-12-06T18:35:57.941 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159144.log 2023-12-06T18:35:57.941 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139031.log 2023-12-06T18:35:57.941 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.159144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159144.log.gz 2023-12-06T18:35:57.941 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139031.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139031.log.gz 2023-12-06T18:35:57.941 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122995.log 2023-12-06T18:35:57.941 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158696.log 2023-12-06T18:35:57.941 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122995.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.122995.log.gz 2023-12-06T18:35:57.941 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.158696.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158696.log.gz 2023-12-06T18:35:57.941 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131100.log 2023-12-06T18:35:57.942 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129161.log 2023-12-06T18:35:57.942 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131100.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131100.log.gz 2023-12-06T18:35:57.942 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129161.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129161.log.gz 2023-12-06T18:35:57.942 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131709.log 2023-12-06T18:35:57.942 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155736.log 2023-12-06T18:35:57.942 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131709.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131709.log.gz 2023-12-06T18:35:57.942 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155736.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155736.log.gz 2023-12-06T18:35:57.942 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129924.log 2023-12-06T18:35:57.942 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114518.log 2023-12-06T18:35:57.943 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129924.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129924.log.gz 2023-12-06T18:35:57.943 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.114518.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114518.log.gz 2023-12-06T18:35:57.943 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162202.log 2023-12-06T18:35:57.943 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122742.log 2023-12-06T18:35:57.943 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.162202.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162202.log.gz 2023-12-06T18:35:57.943 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.122742.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122742.log.gz 2023-12-06T18:35:57.943 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157371.log 2023-12-06T18:35:57.943 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140551.log 2023-12-06T18:35:57.943 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157371.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157371.log.gz 2023-12-06T18:35:57.943 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140551.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140551.log.gz 2023-12-06T18:35:57.944 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146935.log 2023-12-06T18:35:57.944 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124992.log 2023-12-06T18:35:57.944 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.146935.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146935.log.gz 2023-12-06T18:35:57.944 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124992.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124992.log.gz 2023-12-06T18:35:57.944 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132546.log 2023-12-06T18:35:57.944 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127630.log 2023-12-06T18:35:57.944 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.132546.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132546.log.gz 2023-12-06T18:35:57.944 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.127630.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127630.log.gz 2023-12-06T18:35:57.944 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140007.log 2023-12-06T18:35:57.945 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137256.log 2023-12-06T18:35:57.945 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.140007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140007.log.gz 2023-12-06T18:35:57.945 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.137256.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137256.log.gz 2023-12-06T18:35:57.945 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142139.log 2023-12-06T18:35:57.945 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124261.log 2023-12-06T18:35:57.945 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142139.log.gz 2023-12-06T18:35:57.945 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124261.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124261.log.gz 2023-12-06T18:35:57.945 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135333.log 2023-12-06T18:35:57.945 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128855.log 2023-12-06T18:35:57.946 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135333.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135333.log.gz 2023-12-06T18:35:57.946 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128855.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128855.log.gz 2023-12-06T18:35:57.946 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124669.log 2023-12-06T18:35:57.946 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157670.log 2023-12-06T18:35:57.946 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.124669.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124669.log.gz 2023-12-06T18:35:57.946 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.157670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157670.log.gz 2023-12-06T18:35:57.946 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135063.log 2023-12-06T18:35:57.946 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142182.log 2023-12-06T18:35:57.946 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.135063.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135063.log.gz 2023-12-06T18:35:57.947 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.142182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142182.log.gz 2023-12-06T18:35:57.947 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139267.log 2023-12-06T18:35:57.947 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120832.log 2023-12-06T18:35:57.947 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.139267.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139267.log.gz 2023-12-06T18:35:57.947 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120832.log.gz 2023-12-06T18:35:57.947 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120402.log 2023-12-06T18:35:57.947 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155086.log 2023-12-06T18:35:57.947 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.120402.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120402.log.gz 2023-12-06T18:35:57.948 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.155086.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155086.log.gz 2023-12-06T18:35:57.948 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156675.log 2023-12-06T18:35:57.948 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131352.log 2023-12-06T18:35:57.948 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.156675.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156675.log.gz 2023-12-06T18:35:57.948 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.131352.log: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.131352.log.gz 2023-12-06T18:35:57.948 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130323.log 2023-12-06T18:35:57.948 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125111.log 2023-12-06T18:35:57.948 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.130323.log: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.130323.log.gz 2023-12-06T18:35:57.948 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.125111.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.125111.log.gz 2023-12-06T18:35:57.948 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147150.log 2023-12-06T18:35:57.949 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153369.log 2023-12-06T18:35:57.949 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.147150.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147150.log.gz 2023-12-06T18:35:57.949 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145045.log 2023-12-06T18:35:57.949 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.153369.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153369.log.gz 2023-12-06T18:35:57.949 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.145045.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145045.log.gz 2023-12-06T18:35:57.949 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160262.log 2023-12-06T18:35:57.949 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119220.log 2023-12-06T18:35:57.949 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.160262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160262.log.gz 2023-12-06T18:35:57.949 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.119220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119220.log.gz 2023-12-06T18:35:57.950 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128753.log 2023-12-06T18:35:57.950 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128753.log.gz 2023-12-06T18:35:57.950 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128838.log 2023-12-06T18:35:57.950 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129025.log 2023-12-06T18:35:57.950 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.128838.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128838.log.gz 2023-12-06T18:35:57.950 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.129025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129025.log.gz 2023-12-06T18:35:57.950 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152423.log 2023-12-06T18:35:57.950 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.152423.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152423.log.gz 2023-12-06T18:35:58.059 INFO:teuthology.orchestra.run.smithi123.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-12-06T18:35:59.659 INFO:teuthology.orchestra.run.smithi123.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-12-06T18:36:01.417 INFO:teuthology.orchestra.run.smithi123.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-12-06T18:36:29.562 INFO:teuthology.orchestra.run.smithi123.stderr: 96.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-12-06T18:36:49.275 INFO:teuthology.orchestra.run.smithi123.stderr: 97.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-12-06T18:36:49.276 INFO:teuthology.orchestra.run.smithi123.stderr: 2023-12-06T18:36:49.276 INFO:teuthology.orchestra.run.smithi123.stderr:real 0m52.358s 2023-12-06T18:36:49.277 INFO:teuthology.orchestra.run.smithi123.stderr:user 1m28.598s 2023-12-06T18:36:49.277 INFO:teuthology.orchestra.run.smithi123.stderr:sys 0m4.488s 2023-12-06T18:36:49.277 INFO:tasks.ceph:Archiving logs... 2023-12-06T18:36:49.277 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-06_15:04:09-rbd-wip-yuri6-testing-2023-12-05-0753-pacific-distro-default-smithi/7480284/remote/smithi123/log 2023-12-06T18:36:49.279 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-06T18:36:59.245 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-06T18:36:59.257 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-06T18:36:59.258 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-06T18:36:59.316 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-06T18:36:59.324 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-06T18:36:59.325 DEBUG:teuthology.orchestra.run.smithi123:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-06T18:36:59.354 INFO:teuthology.orchestra.run.smithi123.stderr:bash: ntpq: command not found 2023-12-06T18:36:59.356 INFO:teuthology.orchestra.run.smithi123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-06T18:36:59.356 INFO:teuthology.orchestra.run.smithi123.stdout:=============================================================================== 2023-12-06T18:36:59.357 INFO:teuthology.orchestra.run.smithi123.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 49 +797us[ +797us] +/- 79ms 2023-12-06T18:36:59.357 INFO:teuthology.orchestra.run.smithi123.stdout:^* hv02.front.sepia.ceph.com 3 8 377 195 -2308us[-2359us] +/- 57ms 2023-12-06T18:36:59.357 INFO:teuthology.orchestra.run.smithi123.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 47 +2522us[+2522us] +/- 87ms 2023-12-06T18:36:59.357 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-12-06T18:36:59.358 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-06T18:36:59.402 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-06T18:36:59.403 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-06T18:36:59.475 DEBUG:teuthology.orchestra.run.smithi123:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-06T18:36:59.573 DEBUG:teuthology.orchestra.run.smithi123:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-06T18:36:59.606 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-06T18:36:59.607 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-06T18:36:59.622 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-06T18:36:59.638 INFO:teuthology.task.internal:Duration was 12136.702291 seconds 2023-12-06T18:36:59.638 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-06T18:36:59.647 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-06T18:36:59.648 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-06T18:36:59.695 INFO:teuthology.orchestra.run.smithi123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-06T18:36:59.767 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-06T18:36:59.767 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi123.front.sepia.ceph.com 2023-12-06T18:36:59.768 DEBUG:teuthology.orchestra.run.smithi123:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-06T18:36:59.790 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-06T18:36:59.790 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-06T18:36:59.868 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-06T18:36:59.869 DEBUG:teuthology.orchestra.run.smithi123:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-06T18:36:59.976 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-06T18:36:59.986 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-06T18:36:59.986 DEBUG:teuthology.orchestra.run.smithi123:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-06T18:37:00.014 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-06T18:37:00.043 DEBUG:teuthology.orchestra.run.smithi123:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-06T18:37:00.080 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = core 2023-12-06T18:37:00.102 DEBUG:teuthology.orchestra.run.smithi123:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-06T18:37:00.158 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-06T18:37:00.159 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-06T18:37:00.169 INFO:teuthology.task.internal:Transferring archived files... 2023-12-06T18:37:00.171 DEBUG:teuthology.misc:Transferring archived files from smithi123:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-06_15:04:09-rbd-wip-yuri6-testing-2023-12-05-0753-pacific-distro-default-smithi/7480284/remote/smithi123 2023-12-06T18:37:00.171 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-06T18:37:00.238 INFO:teuthology.task.internal:Removing archive directory... 2023-12-06T18:37:00.238 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-06T18:37:00.289 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-06T18:37:00.299 INFO:teuthology.task.internal:Not uploading archives. 2023-12-06T18:37:00.300 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-06T18:37:00.329 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-06T18:37:00.329 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-06T18:37:00.346 INFO:teuthology.orchestra.run.smithi123.stdout: 525979 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Dec 6 18:37 /home/ubuntu/cephtest 2023-12-06T18:37:00.347 INFO:teuthology.orchestra.run.smithi123.stdout: 920537 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Dec 6 15:26 /home/ubuntu/cephtest/mnt.0 2023-12-06T18:37:00.347 INFO:teuthology.orchestra.run.smithi123.stdout: 920538 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Dec 6 15:26 /home/ubuntu/cephtest/mnt.0/client.0 2023-12-06T18:37:00.347 INFO:teuthology.orchestra.run.smithi123.stdout: 920579 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Dec 6 15:26 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-06T18:37:00.348 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-06T18:37:00.348 INFO:teuthology.orchestra.run.smithi123.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-12-06T18:37:00.348 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi123 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-12-06T18:37:00.356 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-06T18:37:00.367 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-06T18:37:00.422 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi123 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-12-06T18:37:00.422 INFO:teuthology.nuke:Checking targets against current locks 2023-12-06T18:37:00.453 DEBUG:teuthology.nuke:shortname: smithi123 2023-12-06T18:37:00.454 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-06T18:37:00.477 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-06_15:04:09-rbd-wip-yuri6-testing-2023-12-05-0753-pacific-distro-default-smithi/7480284', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-06 15:06:31.275173', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHeQVPISHcmI5TLqh0nLOypLb2joRoA+bSMQnZFLfT13MuvqO9kaVTuEeunWyXow20WNJyApaaPv4vHQNfEtb9M='} 2023-12-06T18:37:00.522 INFO:teuthology.orchestra.console.smithi123:Power off 2023-12-06T18:37:00.522 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-06T18:37:00.546 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off 2023-12-06T18:37:00.546 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T18:37:00.570 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-12-06T18:37:04.572 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T18:37:04.682 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-12-06T18:37:08.683 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T18:37:08.794 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-12-06T18:37:12.798 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T18:37:12.908 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-12-06T18:37:13.008 INFO:teuthology.orchestra.console.smithi123:Power off completed 2023-12-06T18:37:13.114 INFO:teuthology.run:Summary data: description: rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_generic} duration: 12136.702291250229 failure_reason: 'Command failed (workunit test rbd/cli_generic.sh) on smithi123 with status 124: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d03fca4f35d43f61b4679936aef7bd2f01cced0b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=82a938fb608a45008aeabfcc22f1f701 status: fail success: false 2023-12-06T18:37:13.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-06T18:37:13.181 INFO:teuthology.run:FAIL